02.12.2021 17:25:00,025 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 256
02.12.2021 17:25:00,048 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:00,063 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59941ms delay out of 60000ms. Remaining 59ms. Executor queue at 1
02.12.2021 17:25:00,066 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59766ms for 60000ms of delay, sleeping for 244ms
02.12.2021 17:25:00,069 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:00,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:00,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,074 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,074 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:00,078 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:00,078 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:00,078 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=64) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8,group_instance_id=null}
02.12.2021 17:25:00,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,082 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,082 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:00,125 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 156
02.12.2021 17:25:00,149 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:00,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:00,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,167 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,167 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 113
02.12.2021 17:25:00,174 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:00,182 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=64): org.apache.kafka.common.requests.HeartbeatResponse@24901cda
02.12.2021 17:25:00,182 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:00,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 56
02.12.2021 17:25:00,249 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:00,268 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 13
02.12.2021 17:25:00,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:00,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,282 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,282 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:00,282 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 185 and member id staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:00,282 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=54) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=185,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf,group_instance_id=null}
02.12.2021 17:25:00,282 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 385
02.12.2021 17:25:00,282 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:00,282 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 185 and member id staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:00,283 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=54) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=185,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82,group_instance_id=null}
02.12.2021 17:25:00,282 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,282 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=54): org.apache.kafka.common.requests.HeartbeatResponse@10afdb62
02.12.2021 17:25:00,283 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:00,283 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 41
02.12.2021 17:25:00,283 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 185 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf
02.12.2021 17:25:00,283 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:00,283 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=54): org.apache.kafka.common.requests.HeartbeatResponse@126ed852
02.12.2021 17:25:00,284 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:00,284 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:00,284 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 123, -60, 27, -87, -99, 46, 69, 70, -123, -109, 86, 85, 111, -45, 14, -12, 0, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:00,284 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=55) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:00,284 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 383
02.12.2021 17:25:00,284 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 185 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82
02.12.2021 17:25:00,284 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:00,285 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:00,285 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 123, -60, 27, -87, -99, 46, 69, 70, -123, -109, 86, 85, 111, -45, 14, -12, 0, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:00,285 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=55) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:00,285 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 39
02.12.2021 17:25:00,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 10 records with 10 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,312 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:00,312 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 11 iterations.
02.12.2021 17:25:00,312 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 0 records with 11 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,312 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:00,312 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:00,312 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1140634, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:00,312 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1140644, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:00,312 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:00,313 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-3, new queue size is 10
02.12.2021 17:25:00,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,313 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:00,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 11 iterations.
02.12.2021 17:25:00,314 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59595ms for 60000ms of delay, sleeping for 415ms
02.12.2021 17:25:00,324 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:00,324 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,324 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,324 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,324 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,325 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:00,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:00,375 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:00,382 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:00,383 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:00,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:00,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,448 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,448 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:00,475 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:00,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,493 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:00,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:00,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:00,494 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:00,494 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:00,496 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:00,496 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,496 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,496 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,496 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,496 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,496 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,496 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,497 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:00,549 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:00,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:00,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,575 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,575 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:00,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,583 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:00,649 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:00,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,668 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,668 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:00,675 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:00,736 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59893ms for 60000ms of delay, sleeping for 117ms
02.12.2021 17:25:00,750 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:00,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:00,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,826 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,827 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:00,851 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:00,856 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58911ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:00,874 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119801ms delay out of 120000ms. Remaining 199ms. Executor queue at 0
02.12.2021 17:25:00,874 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:00,874 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 185 and member id staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:00,874 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=50) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=185,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336,group_instance_id=null}
02.12.2021 17:25:00,875 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119734ms for 120000ms of delay, sleeping for 276ms
02.12.2021 17:25:00,883 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:00,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:00,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,948 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,948 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:00,975 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=50): org.apache.kafka.common.requests.HeartbeatResponse@8ff4eb7
02.12.2021 17:25:00,975 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:00,983 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:00,995 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:00,995 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,995 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:00,995 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,995 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:00,995 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,995 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:00,995 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:00,995 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:00,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:00,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,996 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,997 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:01,049 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:01,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,076 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,076 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:01,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,084 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,084 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,084 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,084 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,084 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,084 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,084 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,084 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:01,149 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:01,155 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119070ms for 120000ms of delay, sleeping for 940ms
02.12.2021 17:25:01,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,169 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,169 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:01,176 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:01,249 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:01,276 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:01,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,328 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:01,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:01,377 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:01,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,448 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,449 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:01,477 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:01,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,495 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:01,496 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,496 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:01,496 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,496 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:01,496 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:01,496 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:01,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,497 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,497 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:01,549 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:01,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,577 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,577 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,577 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,577 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,577 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,577 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,577 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,577 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:01,584 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,585 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:01,650 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:01,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,670 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,671 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,671 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,671 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,677 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:01,675 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 499
02.12.2021 17:25:01,750 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:01,778 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:01,830 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,835 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,835 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:01,851 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:01,856 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59911ms delay out of 60000ms. Remaining 89ms. Executor queue at 0
02.12.2021 17:25:01,858 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58800ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:01,878 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:01,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,949 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,949 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 236
02.12.2021 17:25:01,978 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:01,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,996 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:01,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:01,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:01,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:01,997 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:01,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,997 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,998 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:02,050 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 135
02.12.2021 17:25:02,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,079 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,082 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 148
02.12.2021 17:25:02,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,086 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,086 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:02,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 10 records with 23 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:02,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 63618ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:02,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:02,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 24 iterations.
02.12.2021 17:25:02,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 0 records with 24 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:02,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 63618ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:02,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:02,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:02,097 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:02,098 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:02,098 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:02,098 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 123, -60, 27, -87, -99, 46, 69, 70, -123, -109, 86, 85, 111, -45, 14, -12, 0, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 8])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:02,098 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=51) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:02,099 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1001673, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:02,099 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1001683, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:02,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:02,100 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] task [0_8] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-8, new queue size is 10
02.12.2021 17:25:02,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,100 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:02,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 24 iterations.
02.12.2021 17:25:02,101 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119999ms for 120000ms of delay, sleeping for 11ms
02.12.2021 17:25:02,113 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119990ms for 120000ms of delay, sleeping for 20ms
02.12.2021 17:25:02,141 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119914ms for 120000ms of delay, sleeping for 96ms
02.12.2021 17:25:02,150 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 35
02.12.2021 17:25:02,176 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:02,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:02,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,178 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,178 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:02,183 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 48
02.12.2021 17:25:02,185 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:02,185 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:02,185 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,186 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=54) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42,group_instance_id=null}
02.12.2021 17:25:02,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 261
02.12.2021 17:25:02,191 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=54): org.apache.kafka.common.requests.HeartbeatResponse@4e3ed298
02.12.2021 17:25:02,192 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:02,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 257
02.12.2021 17:25:02,195 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 254
02.12.2021 17:25:02,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,234 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:02,234 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:02,234 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=54) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422,group_instance_id=null}
02.12.2021 17:25:02,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 348
02.12.2021 17:25:02,234 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=54): org.apache.kafka.common.requests.HeartbeatResponse@6b716a46
02.12.2021 17:25:02,234 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:02,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 348
02.12.2021 17:25:02,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 348
02.12.2021 17:25:02,238 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119503ms for 120000ms of delay, sleeping for 507ms
02.12.2021 17:25:02,297 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 152
02.12.2021 17:25:02,335 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 247
02.12.2021 17:25:02,336 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,336 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,336 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,336 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,336 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,336 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,336 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,336 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,336 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:02,397 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 52
02.12.2021 17:25:02,437 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 145
02.12.2021 17:25:02,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:02,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,449 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,450 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:02,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:02,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,497 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:02,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:02,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:02,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:02,498 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:02,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:02,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,498 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,499 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:02,538 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 44
02.12.2021 17:25:02,550 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:02,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:02,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,583 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:02,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,590 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:02,651 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:02,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,680 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,680 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,680 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,680 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,680 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,680 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,680 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,680 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:02,683 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:02,751 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119586ms for 120000ms of delay, sleeping for 424ms
02.12.2021 17:25:02,751 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:02,787 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:02,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,837 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,837 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:02,854 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:02,858 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59800ms delay out of 60000ms. Remaining 200ms. Executor queue at 0
02.12.2021 17:25:02,859 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59711ms for 60000ms of delay, sleeping for 299ms
02.12.2021 17:25:02,889 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:02,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,951 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,951 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:02,990 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:02,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:02,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,998 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:02,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:02,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:02,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:02,999 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:03,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,000 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,000 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:03,051 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:03,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:03,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,083 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,084 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,084 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,084 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,084 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,084 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,084 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:03,091 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:03,091 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:03,091 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=65) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8,group_instance_id=null}
02.12.2021 17:25:03,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:03,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,094 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,094 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:03,152 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:03,160 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59709ms for 60000ms of delay, sleeping for 301ms
02.12.2021 17:25:03,180 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:03,180 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,180 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,180 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,180 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,180 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,180 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,180 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,180 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:03,182 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119593ms for 120000ms of delay, sleeping for 417ms
02.12.2021 17:25:03,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:03,191 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=65): org.apache.kafka.common.requests.HeartbeatResponse@6fcf014e
02.12.2021 17:25:03,191 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:03,252 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:03,284 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:03,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,340 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,340 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,340 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,340 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,340 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,340 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,342 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:03,352 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:03,385 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:03,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,452 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,453 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:03,462 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59589ms for 60000ms of delay, sleeping for 421ms
02.12.2021 17:25:03,485 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:03,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:03,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,499 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:03,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:03,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:03,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:03,500 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:03,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,501 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,501 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,501 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:03,553 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:03,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,587 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:03,595 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,595 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,595 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,599 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,599 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:03,603 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119663ms for 120000ms of delay, sleeping for 347ms
02.12.2021 17:25:03,654 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:03,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,681 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,682 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:03,688 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:03,755 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:03,788 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:03,807 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=58): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', members=[])
02.12.2021 17:25:03,807 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', members=[])
02.12.2021 17:25:03,807 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:03,807 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=55, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', protocol='stream'}
02.12.2021 17:25:03,807 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=55, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=55, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:03,808 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=59) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b,group_instance_id=null,assignments=[]}
02.12.2021 17:25:03,808 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=41): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', members=[])
02.12.2021 17:25:03,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 193
02.12.2021 17:25:03,808 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', members=[])
02.12.2021 17:25:03,807 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=58): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', members=[])
02.12.2021 17:25:03,814 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', members=[])
02.12.2021 17:25:03,814 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:03,814 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=55, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', protocol='stream'}
02.12.2021 17:25:03,814 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=55, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=55, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:03,815 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=59) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21,group_instance_id=null,assignments=[]}
02.12.2021 17:25:03,815 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 284
02.12.2021 17:25:03,814 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:03,822 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=55, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', protocol='stream'}
02.12.2021 17:25:03,823 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=55, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=55, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:03,827 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=42) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d,group_instance_id=null,assignments=[]}
02.12.2021 17:25:03,827 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 173
02.12.2021 17:25:03,844 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:03,844 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,844 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,844 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,844 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,844 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,845 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:03,862 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:03,882 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=59): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:03,882 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=59): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:03,882 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=42): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])
02.12.2021 17:25:03,882 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:03,883 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=55, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', protocol='stream'}
02.12.2021 17:25:03,883 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 55 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21
02.12.2021 17:25:03,883 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:03,883 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:03,883 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:03,883 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:03,883 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:03,883 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906] State transition from RUNNING to REBALANCING
02.12.2021 17:25:03,884 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:03,884 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 217
02.12.2021 17:25:03,885 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59922ms for 60000ms of delay, sleeping for 88ms
02.12.2021 17:25:03,882 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:03,883 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])
02.12.2021 17:25:03,886 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=55, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', protocol='stream'}
02.12.2021 17:25:03,887 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 55 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b
02.12.2021 17:25:03,886 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=55, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', protocol='stream'}
02.12.2021 17:25:03,887 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:03,887 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:03,888 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:03,888 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:03,888 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:03,887 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 55 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d
02.12.2021 17:25:03,888 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:03,889 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 119
02.12.2021 17:25:03,888 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:03,889 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:03,890 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:03,889 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1474] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer] Requested to schedule immediate rebalance for new tasks to be safely revoked from current owner.
02.12.2021 17:25:03,890 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:03,890 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:03,891 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:03,891 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 117
02.12.2021 17:25:03,952 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119764ms for 120000ms of delay, sleeping for 246ms
02.12.2021 17:25:03,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,954 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,955 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:03,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 10 records with 11 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:03,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 12 iterations.
02.12.2021 17:25:03,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 0 records with 12 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:03,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:03,976 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1140644, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:03,976 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1140654, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:03,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:03,976 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-3, new queue size is 10
02.12.2021 17:25:03,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,976 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:03,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 12 iterations.
02.12.2021 17:25:03,978 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59294ms for 60000ms of delay, sleeping for 716ms
02.12.2021 17:25:03,984 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 115
02.12.2021 17:25:03,990 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:03,990 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 11
02.12.2021 17:25:03,995 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 6
02.12.2021 17:25:04,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:04,002 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Transiting to restore active tasks: {}
02.12.2021 17:25:04,002 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:04,002 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Paused partitions [] from the restore consumer
02.12.2021 17:25:04,002 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:04,002 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Transiting to update standby tasks: {}
02.12.2021 17:25:04,002 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:04,002 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Resumed partitions [] from the restore consumer
02.12.2021 17:25:04,002 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:04,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Initialization call done. State is RUNNING
02.12.2021 17:25:04,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,002 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:04,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:04,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:04,002 INFO [org.apache.kafka.streams.processor.internals.StreamThread:555] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Triggering the followup rebalance scheduled for 0 ms.
02.12.2021 17:25:04,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,006 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:04,009 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:04,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:04,009 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 55 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d
02.12.2021 17:25:04,009 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:04,010 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:04,009 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:04,010 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:04,011 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:04,011 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:04,011 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:04,011 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:04,011 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:04,011 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:04,011 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,011 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,011 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,011 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,011 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,011 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,011 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,011 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:04,010 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 70, -39, -14, -119, 6, 48, 75, 25, -73, -14, -59, -98, 2, 41, -103, 6, 0, 0, 0, 0, 0, 0, 0, 0, 20, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:04,011 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=43) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:04,011 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 498
02.12.2021 17:25:04,055 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:04,084 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 15
02.12.2021 17:25:04,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:04,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,088 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,088 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:04,095 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:04,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:04,100 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:04,100 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:04,100 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:04,100 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:04,100 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:04,100 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:04,100 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:04,100 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:04,100 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906] State transition from REBALANCING to RUNNING
02.12.2021 17:25:04,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:04,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,100 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,100 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:04,111 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:04,155 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:04,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,183 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,183 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:04,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:04,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 10 records with 24 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:04,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 65720ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:04,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:04,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 25 iterations.
02.12.2021 17:25:04,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 0 records with 25 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:04,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 65720ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:04,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:04,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:04,200 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1001683, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:04,200 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1001693, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:04,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:04,204 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] task [0_8] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-8, new queue size is 10
02.12.2021 17:25:04,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,202 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 398
02.12.2021 17:25:04,204 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:04,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 25 iterations.
02.12.2021 17:25:04,207 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119456ms for 120000ms of delay, sleeping for 554ms
02.12.2021 17:25:04,212 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:04,256 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:04,288 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:04,305 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 295
02.12.2021 17:25:04,314 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:04,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:04,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,345 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,346 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:04,356 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:04,389 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:04,405 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:04,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:04,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:04,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,456 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,457 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:04,489 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:04,505 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:04,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:04,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,510 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:04,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:04,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:04,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:04,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:04,512 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,512 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,512 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,512 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,512 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,512 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,512 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,512 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:04,557 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:04,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:04,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,588 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:04,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,604 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:04,612 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:04,658 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:04,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:04,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,689 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,689 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:04,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,692 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:04,705 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59565ms for 60000ms of delay, sleeping for 445ms
02.12.2021 17:25:04,706 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:04,713 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:04,758 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:04,768 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119981ms for 120000ms of delay, sleeping for 29ms
02.12.2021 17:25:04,791 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:04,802 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119835ms for 120000ms of delay, sleeping for 175ms
02.12.2021 17:25:04,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:04,821 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 191
02.12.2021 17:25:04,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,848 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,848 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:04,862 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:04,892 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:04,909 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:04,922 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 90
02.12.2021 17:25:04,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,957 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,958 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 227
02.12.2021 17:25:04,980 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119728ms for 120000ms of delay, sleeping for 282ms
02.12.2021 17:25:04,980 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=55): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', members=[])
02.12.2021 17:25:04,980 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', members=[])
02.12.2021 17:25:04,980 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:04,980 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=186, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', protocol='stream'}
02.12.2021 17:25:04,980 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=186, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=186, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:04,980 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=56) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82,group_instance_id=null,assignments=[]}
02.12.2021 17:25:04,980 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 368
02.12.2021 17:25:04,980 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=55): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', members=[])
02.12.2021 17:25:04,981 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', members=[])
02.12.2021 17:25:04,981 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:04,981 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=186, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', protocol='stream'}
02.12.2021 17:25:04,981 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=186, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=186, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:04,982 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=56) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf,group_instance_id=null,assignments=[]}
02.12.2021 17:25:04,982 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 210
02.12.2021 17:25:04,992 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:05,009 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:05,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:05,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,012 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:05,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:05,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:05,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:05,012 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:05,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,013 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,013 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:05,028 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=56): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:05,028 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=56): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:05,028 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:05,028 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:05,029 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=186, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', protocol='stream'}
02.12.2021 17:25:05,029 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=186, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', protocol='stream'}
02.12.2021 17:25:05,029 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 186 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82
02.12.2021 17:25:05,029 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 186 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf
02.12.2021 17:25:05,029 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:05,029 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:05,029 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:05,029 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:05,029 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:05,029 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:05,029 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:05,029 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:05,029 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:05,029 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:05,029 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4] State transition from RUNNING to REBALANCING
02.12.2021 17:25:05,030 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:05,030 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:05,030 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 320
02.12.2021 17:25:05,030 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 164
02.12.2021 17:25:05,058 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 127
02.12.2021 17:25:05,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,089 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,089 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 145
02.12.2021 17:25:05,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,107 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,107 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:05,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:05,130 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 218
02.12.2021 17:25:05,130 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 62
02.12.2021 17:25:05,155 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58872ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:05,158 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 27
02.12.2021 17:25:05,186 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:05,186 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:05,186 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=55) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42,group_instance_id=null}
02.12.2021 17:25:05,186 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:05,187 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=55): org.apache.kafka.common.requests.HeartbeatResponse@e867a13
02.12.2021 17:25:05,187 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:05,187 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 271
02.12.2021 17:25:05,187 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 271
02.12.2021 17:25:05,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 45
02.12.2021 17:25:05,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:05,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:05,193 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:05,193 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:05,193 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:05,193 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:05,194 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:05,194 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:05,194 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:05,194 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:05,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:05,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,195 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:05,207 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:05,214 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:05,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 118
02.12.2021 17:25:05,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:05,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:05,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:05,238 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:05,238 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:05,238 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=55) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422,group_instance_id=null}
02.12.2021 17:25:05,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 351
02.12.2021 17:25:05,238 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=55): org.apache.kafka.common.requests.HeartbeatResponse@299a40c1
02.12.2021 17:25:05,238 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:05,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 351
02.12.2021 17:25:05,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 350
02.12.2021 17:25:05,263 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119377ms for 120000ms of delay, sleeping for 633ms
02.12.2021 17:25:05,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 171
02.12.2021 17:25:05,297 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:05,308 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:05,316 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:05,331 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 17
02.12.2021 17:25:05,339 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 250
02.12.2021 17:25:05,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:05,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:05,348 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:05,348 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:05,348 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:05,348 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:05,348 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:05,348 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:05,348 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:05,348 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:05,348 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4] State transition from REBALANCING to RUNNING
02.12.2021 17:25:05,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:05,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,348 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,349 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:05,388 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 71
02.12.2021 17:25:05,398 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:05,412 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:05,416 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:05,439 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 150
02.12.2021 17:25:05,449 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:05,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,460 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,461 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:05,499 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:05,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,513 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:05,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:05,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:05,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:05,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:05,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 94
02.12.2021 17:25:05,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,514 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:05,539 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 50
02.12.2021 17:25:05,549 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:05,561 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:05,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,594 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,594 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,594 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,594 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,594 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,599 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:05,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,605 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:05,607 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:05,609 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,613 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,613 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:05,615 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:05,651 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:05,661 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:05,703 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:05,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,707 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,708 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,708 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,709 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 396
02.12.2021 17:25:05,708 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,717 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 396
02.12.2021 17:25:05,715 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:05,718 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 296
02.12.2021 17:25:05,751 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:05,766 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:05,817 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 296
02.12.2021 17:25:05,818 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 397
02.12.2021 17:25:05,810 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:05,819 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:05,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,851 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,851 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:05,868 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:05,900 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119780ms for 120000ms of delay, sleeping for 230ms
02.12.2021 17:25:05,918 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:05,918 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:05,919 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 186
02.12.2021 17:25:05,921 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 93
02.12.2021 17:25:05,953 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:05,962 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:05,962 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,962 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,966 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:06,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:06,018 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:06,018 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,018 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:06,018 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,018 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,018 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:06,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:06,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,019 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:06,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,020 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:06,020 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:06,020 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:06,020 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 195
02.12.2021 17:25:06,020 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 85
02.12.2021 17:25:06,053 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:06,066 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:06,102 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:06,102 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:06,102 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=66) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8,group_instance_id=null}
02.12.2021 17:25:06,108 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:06,108 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,108 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,108 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,108 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,108 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,108 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,108 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,110 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:06,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:06,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,114 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:06,120 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:06,123 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 92
02.12.2021 17:25:06,133 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119939ms for 120000ms of delay, sleeping for 71ms
02.12.2021 17:25:06,154 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:06,155 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59872ms delay out of 60000ms. Remaining 128ms. Executor queue at 0
02.12.2021 17:25:06,156 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59481ms for 60000ms of delay, sleeping for 529ms
02.12.2021 17:25:06,167 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:06,202 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=66): org.apache.kafka.common.requests.HeartbeatResponse@37fa6b43
02.12.2021 17:25:06,202 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:06,206 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119978ms for 120000ms of delay, sleeping for 32ms
02.12.2021 17:25:06,210 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:06,214 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:06,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:06,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,215 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,215 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:06,222 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:06,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 10 records with 25 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:06,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 67760ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:06,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:06,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 26 iterations.
02.12.2021 17:25:06,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 0 records with 26 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:06,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 67760ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:06,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:06,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:06,240 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=51): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', members=[])
02.12.2021 17:25:06,240 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', members=[])
02.12.2021 17:25:06,240 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:06,240 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=186, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', protocol='stream'}
02.12.2021 17:25:06,240 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=186, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=186, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:06,240 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1001693, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:06,240 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1001703, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:06,240 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=52) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336,group_instance_id=null,assignments=[]}
02.12.2021 17:25:06,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:06,240 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] task [0_8] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-8, new queue size is 10
02.12.2021 17:25:06,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,241 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:06,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,241 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 26 iterations.
02.12.2021 17:25:06,241 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119069ms for 120000ms of delay, sleeping for 941ms
02.12.2021 17:25:06,241 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=52): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:06,241 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=186, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', protocol='stream'}
02.12.2021 17:25:06,255 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:06,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:06,311 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:06,315 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:06,316 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:06,322 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:06,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:06,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,351 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,351 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:06,368 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:06,411 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:06,416 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:06,416 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:06,423 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:06,451 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:06,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:06,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,466 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,467 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,467 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,467 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,467 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:06,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:06,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:06,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:06,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:06,520 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,520 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,520 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,520 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,520 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,520 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,520 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,521 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:06,521 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 287
02.12.2021 17:25:06,521 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:06,521 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,521 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:06,521 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:06,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:06,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:06,552 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:06,567 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:06,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:06,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,610 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,611 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:06,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:06,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,615 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,615 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:06,617 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:06,621 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 186
02.12.2021 17:25:06,652 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:06,668 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:06,690 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58935ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:06,711 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:06,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:06,716 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:06,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,720 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,722 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 85
02.12.2021 17:25:06,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,728 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:06,752 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:06,768 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:06,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,810 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,810 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,810 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,810 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,810 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,810 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:06,811 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 55 and member id staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:06,811 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=60) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b,group_instance_id=null}
02.12.2021 17:25:06,811 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 210
02.12.2021 17:25:06,812 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=60): org.apache.kafka.common.requests.HeartbeatResponse@28f569a1
02.12.2021 17:25:06,812 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:06,812 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 55 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b
02.12.2021 17:25:06,812 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:06,812 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:06,812 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 70, -39, -14, -119, 6, 48, 75, 25, -73, -14, -59, -98, 2, 41, -103, 6, 0, 0, 0, 0, 0, 0, 0, 0, 20, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:06,812 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=61) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:06,813 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 208
02.12.2021 17:25:06,813 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:06,818 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:06,818 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 55 and member id staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:06,818 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=60) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21,group_instance_id=null}
02.12.2021 17:25:06,818 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:06,822 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=60): org.apache.kafka.common.requests.HeartbeatResponse@2a1f21ea
02.12.2021 17:25:06,822 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:06,823 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 55 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21
02.12.2021 17:25:06,824 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:06,825 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:06,829 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 70, -39, -14, -119, 6, 48, 75, 25, -73, -14, -59, -98, 2, 41, -103, 6, 0, 0, 0, 0, 0, 0, 0, 0, 20, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:06,830 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=61) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:06,830 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 398
02.12.2021 17:25:06,831 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 284
02.12.2021 17:25:06,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:06,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,854 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,854 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:06,871 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:06,912 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:06,916 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:06,919 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:06,931 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:06,954 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:06,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:06,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,967 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,967 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:07,016 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:07,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,021 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,021 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:07,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,023 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:07,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:07,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:07,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:07,023 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:07,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:07,055 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:07,068 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:07,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,112 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,112 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:07,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,117 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,117 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:07,132 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:07,155 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:07,168 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:07,185 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119260ms for 120000ms of delay, sleeping for 750ms
02.12.2021 17:25:07,212 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:07,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:07,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,230 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,234 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:07,256 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:07,268 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:07,314 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:07,335 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:07,354 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:07,354 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,354 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,355 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:07,369 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:07,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:07,436 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:07,456 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:07,469 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:07,469 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,469 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,469 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,470 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,470 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,470 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,470 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,470 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:07,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:07,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,524 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:07,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:07,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:07,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:07,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:07,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,524 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:07,537 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:07,556 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:07,574 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 396
02.12.2021 17:25:07,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:07,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,614 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,617 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:07,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,618 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,617 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:07,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,620 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:07,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:07,656 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:07,674 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:07,691 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59936ms delay out of 60000ms. Remaining 64ms. Executor queue at 0
02.12.2021 17:25:07,711 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59916ms for 60000ms of delay, sleeping for 94ms
02.12.2021 17:25:07,718 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:07,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:07,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,743 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,743 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,743 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,743 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,743 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,743 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,744 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 237
02.12.2021 17:25:07,759 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:07,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:07,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 10 records with 12 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:07,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 13 iterations.
02.12.2021 17:25:07,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 0 records with 13 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:07,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:07,815 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1140654, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:07,815 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1140664, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:07,824 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 293
02.12.2021 17:25:07,815 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Main Consumer poll completed in 5 ms and fetched 10 records
02.12.2021 17:25:07,832 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-3, new queue size is 10
02.12.2021 17:25:07,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,832 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:07,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 13 iterations.
02.12.2021 17:25:07,835 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59964ms for 60000ms of delay, sleeping for 46ms
02.12.2021 17:25:07,844 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 137
02.12.2021 17:25:07,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:07,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,860 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,860 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 120
02.12.2021 17:25:07,875 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:07,887 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59705ms for 60000ms of delay, sleeping for 305ms
02.12.2021 17:25:07,929 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:07,937 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119633ms for 120000ms of delay, sleeping for 377ms
02.12.2021 17:25:07,944 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 37
02.12.2021 17:25:07,962 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 18
02.12.2021 17:25:07,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,971 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,971 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 215
02.12.2021 17:25:07,983 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:07,983 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 186 and member id staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:07,983 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=57) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf,group_instance_id=null}
02.12.2021 17:25:07,983 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:07,983 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 261
02.12.2021 17:25:07,983 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=57): org.apache.kafka.common.requests.HeartbeatResponse@7a527166
02.12.2021 17:25:07,984 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:07,984 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:07,984 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 186 and member id staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:07,984 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=57) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82,group_instance_id=null}
02.12.2021 17:25:07,984 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:07,984 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 186 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf
02.12.2021 17:25:07,984 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:07,984 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:07,985 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 123, -60, 27, -87, -99, 46, 69, 70, -123, -109, 86, 85, 111, -45, 14, -12, 0, 0, 0, 0, 0, 0, 0, 0, 19, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:07,985 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=58) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:07,985 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 259
02.12.2021 17:25:07,989 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 376
02.12.2021 17:25:07,990 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=57): org.apache.kafka.common.requests.HeartbeatResponse@685f8d51
02.12.2021 17:25:07,990 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:07,990 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 186 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82
02.12.2021 17:25:07,990 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:07,990 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:07,990 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 123, -60, 27, -87, -99, 46, 69, 70, -123, -109, 86, 85, 111, -45, 14, -12, 0, 0, 0, 0, 0, 0, 0, 0, 19, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:07,990 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=58) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:07,990 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 370
02.12.2021 17:25:08,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,025 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:08,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:08,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:08,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:08,025 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:08,029 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 88
02.12.2021 17:25:08,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:08,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,031 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:08,071 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 115
02.12.2021 17:25:08,083 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:08,085 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:08,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:08,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,118 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,118 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 120
02.12.2021 17:25:08,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:08,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,124 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,125 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:08,176 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 14
02.12.2021 17:25:08,190 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:08,195 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:08,195 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=56) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42,group_instance_id=null}
02.12.2021 17:25:08,195 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59403ms for 60000ms of delay, sleeping for 607ms
02.12.2021 17:25:08,196 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 281
02.12.2021 17:25:08,197 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=56): org.apache.kafka.common.requests.HeartbeatResponse@2bb66fca
02.12.2021 17:25:08,197 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:08,204 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 274
02.12.2021 17:25:08,211 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 260
02.12.2021 17:25:08,219 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 19
02.12.2021 17:25:08,240 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:08,241 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:08,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,241 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=56) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422,group_instance_id=null}
02.12.2021 17:25:08,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 377
02.12.2021 17:25:08,242 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=56): org.apache.kafka.common.requests.HeartbeatResponse@448d0965
02.12.2021 17:25:08,242 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:08,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 376
02.12.2021 17:25:08,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 375
02.12.2021 17:25:08,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:08,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,247 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,247 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:08,314 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 157
02.12.2021 17:25:08,325 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119523ms for 120000ms of delay, sleeping for 487ms
02.12.2021 17:25:08,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 275
02.12.2021 17:25:08,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:08,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,362 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,362 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:08,416 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 55
02.12.2021 17:25:08,443 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 175
02.12.2021 17:25:08,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:08,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,474 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,474 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:08,526 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,526 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,526 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:08,526 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,526 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:08,526 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,526 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:08,526 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:08,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:08,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:08,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,532 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,532 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:08,544 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 74
02.12.2021 17:25:08,575 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:08,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:08,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,618 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,620 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:08,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:08,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,626 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,627 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,629 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:08,675 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:08,721 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:08,747 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:08,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,748 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,750 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:08,778 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:08,804 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59860ms for 60000ms of delay, sleeping for 150ms
02.12.2021 17:25:08,816 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119671ms for 120000ms of delay, sleeping for 339ms
02.12.2021 17:25:08,821 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:08,863 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,863 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,863 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,863 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,864 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:08,879 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:08,922 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:08,956 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 57201ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:08,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,975 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,975 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:09,022 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:09,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,027 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:09,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:09,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:09,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:09,028 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:09,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,033 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:09,075 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:09,110 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:09,111 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:09,111 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=67) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8,group_instance_id=null}
02.12.2021 17:25:09,120 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,121 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,123 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:09,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:09,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,128 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,129 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:09,161 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119069ms for 120000ms of delay, sleeping for 941ms
02.12.2021 17:25:09,176 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:09,211 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=67): org.apache.kafka.common.requests.HeartbeatResponse@12da8d21
02.12.2021 17:25:09,211 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:09,223 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:09,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:09,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,253 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,253 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:09,259 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:09,259 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 186 and member id staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:09,259 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=53) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336,group_instance_id=null}
02.12.2021 17:25:09,276 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:09,323 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:09,360 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=53): org.apache.kafka.common.requests.HeartbeatResponse@453cad9
02.12.2021 17:25:09,360 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:09,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,365 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,365 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:09,377 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:09,424 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:09,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:09,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,476 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,479 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:09,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:09,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,529 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:09,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:09,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:09,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:09,529 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:09,534 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,534 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,534 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,534 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,534 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,534 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,534 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,534 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:09,580 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:09,623 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,624 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,627 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:09,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,629 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,629 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:09,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,632 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,632 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:09,681 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:09,739 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:09,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:09,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,755 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,756 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:09,781 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:09,845 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 292
02.12.2021 17:25:09,865 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:09,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,871 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,872 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,872 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,874 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:09,885 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:09,947 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:09,957 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 58202ms delay out of 60000ms. Remaining 1798ms. Executor queue at 0
02.12.2021 17:25:09,958 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 57965ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:09,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:09,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,982 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,982 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:10,030 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,030 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,030 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:10,030 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,030 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:10,030 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:10,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:10,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:10,035 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,035 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,035 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,035 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,035 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,035 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,035 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,035 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,035 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:10,047 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:10,086 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 396
02.12.2021 17:25:10,103 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119968ms for 120000ms of delay, sleeping for 42ms
02.12.2021 17:25:10,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,130 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,139 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,139 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:10,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,140 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,146 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,147 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119812ms for 120000ms of delay, sleeping for 198ms
02.12.2021 17:25:10,146 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,147 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:10,147 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:10,190 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 292
02.12.2021 17:25:10,250 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:10,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:10,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,257 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,257 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:10,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:10,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:10,359 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119251ms for 120000ms of delay, sleeping for 759ms
02.12.2021 17:25:10,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:10,375 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,375 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,375 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,375 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,375 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,375 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,375 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,375 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:10,462 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 185
02.12.2021 17:25:10,462 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 20
02.12.2021 17:25:10,486 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:10,486 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,486 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,497 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:10,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:10,535 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,535 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:10,535 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,535 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:10,535 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,535 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:10,535 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:10,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,538 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:10,539 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:10,649 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:10,651 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,598 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:10,651 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,655 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,655 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,651 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 511 ms and fetched 0 records
02.12.2021 17:25:10,655 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,655 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,655 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,662 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:10,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,664 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:10,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 536 ms and fetched 0 records
02.12.2021 17:25:10,762 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:10,752 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 244
02.12.2021 17:25:10,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,807 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,811 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,863 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,863 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,863 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:10,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,876 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,883 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:10,899 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:10,899 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 263
02.12.2021 17:25:10,960 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 58967ms delay out of 60000ms. Remaining 1033ms. Executor queue at 1
02.12.2021 17:25:10,965 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 57211ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:10,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:10,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,997 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,997 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:11,000 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 162
02.12.2021 17:25:11,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:11,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,040 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:11,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:11,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:11,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:11,040 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:11,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,040 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,040 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:11,097 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:11,100 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 62
02.12.2021 17:25:11,121 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119963ms for 120000ms of delay, sleeping for 47ms
02.12.2021 17:25:11,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,162 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,162 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 78
02.12.2021 17:25:11,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:11,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,166 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,166 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:11,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 10 records with 26 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:11,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 72690ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:11,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:11,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 27 iterations.
02.12.2021 17:25:11,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 0 records with 27 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:11,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 72690ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:11,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:11,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:11,170 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:11,170 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:11,170 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:11,170 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 123, -60, 27, -87, -99, 46, 69, 70, -123, -109, 86, 85, 111, -45, 14, -12, 0, 0, 0, 0, 0, 0, 0, 0, 19, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 8])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:11,171 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=54) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:11,171 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1001703, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:11,171 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1001713, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:11,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:11,172 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] task [0_8] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-8, new queue size is 10
02.12.2021 17:25:11,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,172 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:11,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 27 iterations.
02.12.2021 17:25:11,175 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119927ms for 120000ms of delay, sleeping for 83ms
02.12.2021 17:25:11,190 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,190 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:11,192 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:11,192 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=57) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42,group_instance_id=null}
02.12.2021 17:25:11,190 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 304
02.12.2021 17:25:11,193 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=57): org.apache.kafka.common.requests.HeartbeatResponse@1e96ad
02.12.2021 17:25:11,193 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:11,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 304
02.12.2021 17:25:11,196 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 301
02.12.2021 17:25:11,241 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:11,245 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:11,245 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=57) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422,group_instance_id=null}
02.12.2021 17:25:11,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 422
02.12.2021 17:25:11,248 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=57): org.apache.kafka.common.requests.HeartbeatResponse@10b359f5
02.12.2021 17:25:11,248 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:11,248 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 414
02.12.2021 17:25:11,248 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 414
02.12.2021 17:25:11,259 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119545ms for 120000ms of delay, sleeping for 465ms
02.12.2021 17:25:11,263 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:11,297 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:11,348 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 314
02.12.2021 17:25:11,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:11,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,366 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,367 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:11,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:11,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,384 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,384 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:11,397 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 100
02.12.2021 17:25:11,449 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 213
02.12.2021 17:25:11,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:11,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,499 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,499 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:11,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,541 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,542 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:11,542 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,542 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:11,542 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,542 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:11,542 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:11,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,543 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:11,543 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:11,549 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 113
02.12.2021 17:25:11,600 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:11,650 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 12
02.12.2021 17:25:11,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:11,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,664 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,665 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,665 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:11,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:11,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,667 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,668 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:11,703 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:11,731 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119903ms for 120000ms of delay, sleeping for 107ms
02.12.2021 17:25:11,766 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:11,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:11,845 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119943ms for 120000ms of delay, sleeping for 67ms
02.12.2021 17:25:11,866 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:11,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,869 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,869 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,869 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,869 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,869 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,869 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,869 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,869 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:11,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,886 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,887 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,887 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,887 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:11,915 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 117799ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:11,921 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 78
02.12.2021 17:25:11,966 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 58212ms delay out of 60000ms. Remaining 1788ms. Executor queue at 1
02.12.2021 17:25:11,967 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 57919ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:11,966 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:11,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:11,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,999 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,001 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:12,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:12,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:12,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,045 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:12,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:12,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:12,044 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:12,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,045 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:12,045 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:12,067 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:12,102 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:12,163 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:12,163 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:12,163 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=68) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8,group_instance_id=null}
02.12.2021 17:25:12,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,166 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,166 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:12,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:12,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,168 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,169 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:12,202 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:12,266 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=68): org.apache.kafka.common.requests.HeartbeatResponse@3608256c
02.12.2021 17:25:12,266 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:12,268 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:12,306 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:12,369 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:12,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,370 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,370 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:12,390 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:12,390 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,390 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,390 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,390 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,390 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,390 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,390 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,390 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:12,410 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:12,469 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:12,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,505 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,505 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:12,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,546 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:12,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,547 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:12,547 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,547 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:12,547 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:12,547 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:12,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:12,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,554 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,555 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:12,570 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:12,605 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:12,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:12,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,668 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,668 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:12,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:12,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,669 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,674 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:12,705 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:12,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:12,806 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:12,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,871 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,871 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:12,877 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:12,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,891 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,891 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:12,907 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:12,916 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 118800ms delay out of 120000ms. Remaining 1200ms. Executor queue at 1
02.12.2021 17:25:12,917 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118677ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:12,967 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 58919ms delay out of 60000ms. Remaining 1081ms. Executor queue at 2
02.12.2021 17:25:12,968 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58900ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:12,977 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:13,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:13,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,006 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,006 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,006 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,006 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,006 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,006 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,006 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:13,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:13,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,047 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:13,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:13,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:13,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:13,048 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:13,055 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,055 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,056 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,056 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:13,077 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:13,106 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:13,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,169 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,170 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:13,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:13,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,175 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,175 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:13,206 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:13,275 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:13,307 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:13,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,372 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,372 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:13,376 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:13,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,392 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,393 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,393 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,393 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,393 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,393 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,393 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:13,407 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:13,476 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:13,507 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,507 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,507 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,507 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,507 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,507 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,507 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,508 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:13,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:13,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,549 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:13,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:13,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:13,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:13,550 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:13,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,557 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,557 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:13,576 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:13,609 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:13,671 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,671 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,671 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,671 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,671 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,671 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,671 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,671 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,672 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:13,678 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:13,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,681 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,685 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:13,709 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:13,786 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:13,811 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:13,851 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=58): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', members=[])
02.12.2021 17:25:13,851 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=58): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', members=[])
02.12.2021 17:25:13,854 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', members=[])
02.12.2021 17:25:13,854 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:13,854 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', members=[])
02.12.2021 17:25:13,864 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:13,865 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=187, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', protocol='stream'}
02.12.2021 17:25:13,865 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=187, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=187, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:13,865 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=59) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf,group_instance_id=null,assignments=[]}
02.12.2021 17:25:13,864 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=187, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', protocol='stream'}
02.12.2021 17:25:13,874 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=187, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=187, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:13,874 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=59) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82,group_instance_id=null,assignments=[]}
02.12.2021 17:25:13,874 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:13,876 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 18
02.12.2021 17:25:13,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:13,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,878 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,882 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,882 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,882 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,882 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:13,889 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:13,894 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,894 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,894 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,895 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:13,913 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:13,917 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119677ms delay out of 120000ms. Remaining 323ms. Executor queue at 2
02.12.2021 17:25:13,919 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119269ms for 120000ms of delay, sleeping for 741ms
02.12.2021 17:25:13,968 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59900ms delay out of 60000ms. Remaining 100ms. Executor queue at 3
02.12.2021 17:25:13,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 10 records with 13 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:13,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 14 iterations.
02.12.2021 17:25:13,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 0 records with 14 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:13,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:13,968 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1140664, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:13,968 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1140674, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:13,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:13,969 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-3, new queue size is 10
02.12.2021 17:25:13,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,969 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:13,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 14 iterations.
02.12.2021 17:25:13,969 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59299ms for 60000ms of delay, sleeping for 711ms
02.12.2021 17:25:13,983 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=59): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:13,983 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=59): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:13,983 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:13,983 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:13,983 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=187, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', protocol='stream'}
02.12.2021 17:25:13,983 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=187, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', protocol='stream'}
02.12.2021 17:25:13,983 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 187 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf
02.12.2021 17:25:13,983 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 187 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82
02.12.2021 17:25:13,983 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:13,983 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:13,983 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:13,983 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:13,983 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:13,984 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:13,984 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:13,984 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:13,984 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:13,984 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4] State transition from RUNNING to REBALANCING
02.12.2021 17:25:13,984 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:13,984 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:13,984 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:13,984 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:13,984 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 412
02.12.2021 17:25:13,990 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:14,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:14,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,008 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 182
02.12.2021 17:25:14,029 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=43): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', members=[])
02.12.2021 17:25:14,029 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=61): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', members=[])
02.12.2021 17:25:14,029 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', members=[])
02.12.2021 17:25:14,029 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:14,029 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=56, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', protocol='stream'}
02.12.2021 17:25:14,029 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=56, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=56, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:14,030 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=62) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21,group_instance_id=null,assignments=[]}
02.12.2021 17:25:14,029 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=61): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', members=[])
02.12.2021 17:25:14,030 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 142
02.12.2021 17:25:14,029 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', members=[])
02.12.2021 17:25:14,031 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:14,030 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', members=[])
02.12.2021 17:25:14,031 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=56, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', protocol='stream'}
02.12.2021 17:25:14,031 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:14,031 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=56, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=56, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:14,031 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=56, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', protocol='stream'}
02.12.2021 17:25:14,032 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=56, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=56, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:14,032 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=44) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d,group_instance_id=null,assignments=[]}
02.12.2021 17:25:14,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 18
02.12.2021 17:25:14,032 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=62) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b,group_instance_id=null,assignments=[]}
02.12.2021 17:25:14,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 24
02.12.2021 17:25:14,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:14,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,050 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:14,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:14,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:14,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:14,051 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:14,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:14,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,057 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,057 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:14,072 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=62): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,072 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=44): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])
02.12.2021 17:25:14,072 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=62): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,072 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])
02.12.2021 17:25:14,072 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=56, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', protocol='stream'}
02.12.2021 17:25:14,072 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,072 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 56 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d
02.12.2021 17:25:14,073 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:14,073 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:14,073 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1474] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer] Requested to schedule immediate rebalance for new tasks to be safely revoked from current owner.
02.12.2021 17:25:14,073 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:14,073 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:14,073 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906] State transition from RUNNING to REBALANCING
02.12.2021 17:25:14,073 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:14,073 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 479
02.12.2021 17:25:14,072 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,072 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=56, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', protocol='stream'}
02.12.2021 17:25:14,074 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=56, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', protocol='stream'}
02.12.2021 17:25:14,074 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 56 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b
02.12.2021 17:25:14,074 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 56 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21
02.12.2021 17:25:14,074 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:14,074 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:14,074 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:14,074 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:14,074 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:14,074 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:14,074 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:14,074 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:14,075 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:14,074 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:14,075 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:14,075 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:14,075 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 100
02.12.2021 17:25:14,075 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 485
02.12.2021 17:25:14,084 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:14,084 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 311
02.12.2021 17:25:14,090 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:14,109 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 81
02.12.2021 17:25:14,173 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 378
02.12.2021 17:25:14,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:14,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:14,175 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:14,175 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 382
02.12.2021 17:25:14,175 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:14,175 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:14,175 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:14,175 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:14,175 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:14,175 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:14,175 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:14,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:14,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,176 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,176 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:14,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:14,186 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,186 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,185 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 210
02.12.2021 17:25:14,185 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:14,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 52
02.12.2021 17:25:14,190 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:14,190 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:14,190 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=58) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42,group_instance_id=null}
02.12.2021 17:25:14,190 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,192 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 316
02.12.2021 17:25:14,193 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=58): org.apache.kafka.common.requests.HeartbeatResponse@388c2e24
02.12.2021 17:25:14,193 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:14,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 315
02.12.2021 17:25:14,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 314
02.12.2021 17:25:14,240 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:14,240 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:14,240 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=58) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422,group_instance_id=null}
02.12.2021 17:25:14,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 448
02.12.2021 17:25:14,241 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=58): org.apache.kafka.common.requests.HeartbeatResponse@707022ff
02.12.2021 17:25:14,241 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:14,242 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 447
02.12.2021 17:25:14,242 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 446
02.12.2021 17:25:14,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 277
02.12.2021 17:25:14,275 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 282
02.12.2021 17:25:14,276 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:14,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 108
02.12.2021 17:25:14,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:14,295 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 213
02.12.2021 17:25:14,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 346
02.12.2021 17:25:14,374 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 177
02.12.2021 17:25:14,376 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 181
02.12.2021 17:25:14,376 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:14,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:14,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:14,383 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:14,383 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:14,383 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:14,383 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:14,384 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:14,384 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:14,384 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:14,384 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:14,385 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:14,385 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,385 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,385 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,385 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,385 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,385 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,385 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,385 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:14,387 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 8
02.12.2021 17:25:14,395 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 113
02.12.2021 17:25:14,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:14,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:14,396 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:14,396 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:14,397 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:14,397 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:14,397 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:14,397 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:14,397 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:14,397 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:14,397 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4] State transition from REBALANCING to RUNNING
02.12.2021 17:25:14,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:14,398 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,398 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,398 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,398 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,398 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,398 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,398 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,398 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:14,444 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 245
02.12.2021 17:25:14,475 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 77
02.12.2021 17:25:14,476 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 81
02.12.2021 17:25:14,477 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:14,485 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:14,498 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:14,496 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 12
02.12.2021 17:25:14,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:14,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,511 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:14,544 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 144
02.12.2021 17:25:14,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:14,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:14,552 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Transiting to restore active tasks: {}
02.12.2021 17:25:14,552 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:14,552 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Paused partitions [] from the restore consumer
02.12.2021 17:25:14,552 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:14,552 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Transiting to update standby tasks: {}
02.12.2021 17:25:14,552 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:14,552 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Resumed partitions [] from the restore consumer
02.12.2021 17:25:14,552 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:14,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Initialization call done. State is RUNNING
02.12.2021 17:25:14,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,552 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:14,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:14,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:14,553 INFO [org.apache.kafka.streams.processor.internals.StreamThread:555] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Triggering the followup rebalance scheduled for 0 ms.
02.12.2021 17:25:14,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:14,553 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 56 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d
02.12.2021 17:25:14,553 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:14,553 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:14,554 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 70, -39, -14, -119, 6, 48, 75, 25, -73, -14, -59, -98, 2, 41, -103, 6, 0, 0, 0, 0, 0, 0, 0, 0, 21, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:14,554 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=45) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:14,554 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:14,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:14,561 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:14,561 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:14,567 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:14,568 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:14,569 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:14,571 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:14,571 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:14,574 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:14,574 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:14,575 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906] State transition from REBALANCING to RUNNING
02.12.2021 17:25:14,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:14,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,575 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,575 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:14,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,576 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:14,577 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:14,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:14,598 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:14,612 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:14,644 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 44
02.12.2021 17:25:14,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 10 records with 27 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:14,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 76182ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:14,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:14,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 28 iterations.
02.12.2021 17:25:14,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 0 records with 28 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:14,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 76182ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:14,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:14,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:14,661 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=54): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', members=[])
02.12.2021 17:25:14,661 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', members=[])
02.12.2021 17:25:14,662 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:14,662 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=187, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', protocol='stream'}
02.12.2021 17:25:14,662 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=187, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=187, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:14,662 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1001713, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:14,662 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1001723, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:14,662 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=55) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336,group_instance_id=null,assignments=[]}
02.12.2021 17:25:14,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:14,663 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] task [0_8] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-8, new queue size is 10
02.12.2021 17:25:14,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,663 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:14,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 28 iterations.
02.12.2021 17:25:14,664 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119579ms for 120000ms of delay, sleeping for 431ms
02.12.2021 17:25:14,676 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:14,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:14,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,677 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,678 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:14,683 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59964ms for 60000ms of delay, sleeping for 46ms
02.12.2021 17:25:14,686 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:14,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:14,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,689 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,691 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,691 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,694 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:14,699 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:14,713 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:14,734 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59733ms for 60000ms of delay, sleeping for 277ms
02.12.2021 17:25:14,763 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=55): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:14,763 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=187, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', protocol='stream'}
02.12.2021 17:25:14,776 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:14,783 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 395
02.12.2021 17:25:14,786 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:14,796 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:14,799 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:14,813 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:14,877 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:14,885 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 293
02.12.2021 17:25:14,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:14,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,886 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,886 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:14,897 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:14,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:14,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,899 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,900 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:14,914 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:14,978 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:14,986 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 192
02.12.2021 17:25:14,986 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:14,997 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:15,001 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:15,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:15,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,013 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,014 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59957ms for 60000ms of delay, sleeping for 53ms
02.12.2021 17:25:15,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,014 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:15,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:15,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,053 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:15,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:15,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:15,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:15,053 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:15,068 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59899ms for 60000ms of delay, sleeping for 111ms
02.12.2021 17:25:15,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,076 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,076 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:15,086 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 92
02.12.2021 17:25:15,087 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:15,100 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119128ms for 120000ms of delay, sleeping for 882ms
02.12.2021 17:25:15,100 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:15,102 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:15,118 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 396
02.12.2021 17:25:15,176 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:15,176 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:15,176 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=69) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8,group_instance_id=null}
02.12.2021 17:25:15,176 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:15,180 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:15,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,181 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,181 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:15,185 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59190ms for 60000ms of delay, sleeping for 820ms
02.12.2021 17:25:15,187 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:15,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:15,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,196 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:15,203 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:15,218 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:15,277 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=69): org.apache.kafka.common.requests.HeartbeatResponse@21da9792
02.12.2021 17:25:15,277 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:15,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:15,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:15,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:15,297 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:15,303 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:15,318 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:15,378 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:15,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:15,390 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,390 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,390 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,390 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,390 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,390 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,390 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,390 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:15,387 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 294
02.12.2021 17:25:15,398 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:15,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,401 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,401 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:15,419 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:15,479 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:15,491 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 190
02.12.2021 17:25:15,491 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:15,498 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:15,502 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:15,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:15,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,514 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30138ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:15,516 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:15,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,554 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:15,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:15,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:15,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:15,554 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:15,577 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,582 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:15,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 89
02.12.2021 17:25:15,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:15,599 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:15,602 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:15,616 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:15,682 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,686 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,693 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 397
02.12.2021 17:25:15,691 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:15,694 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:15,697 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:15,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,699 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30178ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:15,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,699 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:15,702 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:15,717 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:15,793 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:15,795 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:15,793 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 398
02.12.2021 17:25:15,800 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:15,806 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:15,821 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:15,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,891 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,894 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:15,891 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:15,895 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 296
02.12.2021 17:25:15,901 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:15,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,902 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,903 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:15,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:15,983 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119916ms for 120000ms of delay, sleeping for 94ms
02.12.2021 17:25:15,994 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:15,998 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 393
02.12.2021 17:25:16,000 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 191
02.12.2021 17:25:16,001 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:16,003 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:16,007 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59950ms for 60000ms of delay, sleeping for 60ms
02.12.2021 17:25:16,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:16,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,017 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,017 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:16,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:16,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,056 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:16,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:16,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:16,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:16,056 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:16,070 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59727ms for 60000ms of delay, sleeping for 283ms
02.12.2021 17:25:16,078 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119275ms for 120000ms of delay, sleeping for 735ms
02.12.2021 17:25:16,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:16,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,090 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,090 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:16,099 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 292
02.12.2021 17:25:16,100 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 91
02.12.2021 17:25:16,102 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:16,103 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:16,118 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:16,191 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:16,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:16,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,195 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,199 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 192
02.12.2021 17:25:16,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:16,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,199 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,201 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:16,200 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:16,204 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:16,218 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:16,292 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:16,300 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 92
02.12.2021 17:25:16,301 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:16,302 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 398
02.12.2021 17:25:16,305 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:16,318 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:16,354 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 10 records with 14 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,354 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:16,354 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 15 iterations.
02.12.2021 17:25:16,354 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 0 records with 15 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,354 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:16,354 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:16,354 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1140674, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:16,355 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1140684, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:16,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:16,355 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-3, new queue size is 10
02.12.2021 17:25:16,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,355 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:16,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 15 iterations.
02.12.2021 17:25:16,356 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59564ms for 60000ms of delay, sleeping for 446ms
02.12.2021 17:25:16,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:16,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,392 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,392 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 473
02.12.2021 17:25:16,393 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:16,402 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:16,403 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:16,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:16,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,404 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,404 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 460
02.12.2021 17:25:16,419 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:16,493 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 372
02.12.2021 17:25:16,493 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:16,502 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:16,503 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:16,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 360
02.12.2021 17:25:16,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:16,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,519 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:16,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:16,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,557 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:16,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:16,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:16,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:16,557 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:16,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:16,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,590 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 441
02.12.2021 17:25:16,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 272
02.12.2021 17:25:16,602 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:16,603 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:16,605 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 259
02.12.2021 17:25:16,620 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:16,691 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 340
02.12.2021 17:25:16,693 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 172
02.12.2021 17:25:16,701 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:16,701 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,703 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,703 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,703 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,703 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,703 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,702 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:16,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,704 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,703 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,705 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 324
02.12.2021 17:25:16,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,706 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:16,705 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 159
02.12.2021 17:25:16,720 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:16,792 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 239
02.12.2021 17:25:16,793 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 72
02.12.2021 17:25:16,804 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59887ms for 60000ms of delay, sleeping for 123ms
02.12.2021 17:25:16,805 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 224
02.12.2021 17:25:16,806 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:16,810 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 54
02.12.2021 17:25:16,814 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118578ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:16,821 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:16,866 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:16,866 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:16,866 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 187 and member id staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:16,866 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:16,866 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=60) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82,group_instance_id=null}
02.12.2021 17:25:16,866 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:16,866 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 187 and member id staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:16,866 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 38
02.12.2021 17:25:16,866 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=60) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf,group_instance_id=null}
02.12.2021 17:25:16,867 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=60): org.apache.kafka.common.requests.HeartbeatResponse@21fd5362
02.12.2021 17:25:16,867 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:16,867 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 26
02.12.2021 17:25:16,867 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 187 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82
02.12.2021 17:25:16,867 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:16,867 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=60): org.apache.kafka.common.requests.HeartbeatResponse@4434b1bf
02.12.2021 17:25:16,867 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:16,867 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:16,867 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 187 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf
02.12.2021 17:25:16,868 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:16,868 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:16,868 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 123, -60, 27, -87, -99, 46, 69, 70, -123, -109, 86, 85, 111, -45, 14, -12, 0, 0, 0, 0, 0, 0, 0, 0, 20, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:16,868 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=61) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:16,868 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 24
02.12.2021 17:25:16,867 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 123, -60, 27, -87, -99, 46, 69, 70, -123, -109, 86, 85, 111, -45, 14, -12, 0, 0, 0, 0, 0, 0, 0, 0, 20, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:16,868 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=61) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:16,868 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 36
02.12.2021 17:25:16,892 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 139
02.12.2021 17:25:16,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:16,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,892 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,893 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,893 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,893 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,893 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:16,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:16,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,905 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,905 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:16,905 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 124
02.12.2021 17:25:16,907 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:16,921 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:16,928 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59086ms for 60000ms of delay, sleeping for 924ms
02.12.2021 17:25:16,966 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:16,967 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:16,993 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 38
02.12.2021 17:25:17,006 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 23
02.12.2021 17:25:17,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:17,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:17,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,021 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,021 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 169
02.12.2021 17:25:17,029 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,029 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,029 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 56 and member id staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:17,030 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=63) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21,group_instance_id=null}
02.12.2021 17:25:17,030 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 176
02.12.2021 17:25:17,030 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=63): org.apache.kafka.common.requests.HeartbeatResponse@2f72a839
02.12.2021 17:25:17,030 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:17,030 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 56 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21
02.12.2021 17:25:17,030 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:17,030 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:17,030 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 70, -39, -14, -119, 6, 48, 75, 25, -73, -14, -59, -98, 2, 41, -103, 6, 0, 0, 0, 0, 0, 0, 0, 0, 21, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:17,031 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=64) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:17,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 174
02.12.2021 17:25:17,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,034 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,034 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,034 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,034 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,034 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,034 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,034 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 56 and member id staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:17,034 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=63) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b,group_instance_id=null}
02.12.2021 17:25:17,034 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 56
02.12.2021 17:25:17,034 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=63): org.apache.kafka.common.requests.HeartbeatResponse@39cd6250
02.12.2021 17:25:17,034 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:17,034 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 56 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b
02.12.2021 17:25:17,034 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:17,035 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:17,035 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 70, -39, -14, -119, 6, 48, 75, 25, -73, -14, -59, -98, 2, 41, -103, 6, 0, 0, 0, 0, 0, 0, 0, 0, 21, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:17,035 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=64) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:17,035 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 55
02.12.2021 17:25:17,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,058 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:17,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:17,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:17,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:17,058 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:17,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:17,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,090 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,090 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:17,107 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:17,121 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 69
02.12.2021 17:25:17,130 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:17,134 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:17,190 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,190 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:17,191 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:17,191 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=59) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42,group_instance_id=null}
02.12.2021 17:25:17,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 330
02.12.2021 17:25:17,194 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=59): org.apache.kafka.common.requests.HeartbeatResponse@5e79dc4
02.12.2021 17:25:17,194 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:17,195 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 327
02.12.2021 17:25:17,195 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 326
02.12.2021 17:25:17,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:17,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,205 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,205 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:17,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:17,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,206 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,206 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 34
02.12.2021 17:25:17,241 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,241 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:17,241 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=59) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422,group_instance_id=null}
02.12.2021 17:25:17,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 465
02.12.2021 17:25:17,241 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=59): org.apache.kafka.common.requests.HeartbeatResponse@b97e878
02.12.2021 17:25:17,241 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:17,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 465
02.12.2021 17:25:17,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 465
02.12.2021 17:25:17,296 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 225
02.12.2021 17:25:17,349 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 357
02.12.2021 17:25:17,393 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:17,393 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,393 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,393 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,394 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:17,397 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 124
02.12.2021 17:25:17,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:17,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,406 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,406 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:17,450 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 256
02.12.2021 17:25:17,497 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 24
02.12.2021 17:25:17,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,522 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:17,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,552 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 155
02.12.2021 17:25:17,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,567 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:17,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:17,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:17,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:17,571 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:17,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,596 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,596 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,596 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,596 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,596 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,596 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,596 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,596 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:17,623 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:17,661 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 46
02.12.2021 17:25:17,669 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,669 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 187 and member id staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:17,669 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=56) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336,group_instance_id=null}
02.12.2021 17:25:17,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,707 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,707 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:17,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,721 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,721 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:17,725 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:17,769 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=56): org.apache.kafka.common.requests.HeartbeatResponse@59236b7e
02.12.2021 17:25:17,772 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:17,814 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119578ms delay out of 120000ms. Remaining 422ms. Executor queue at 0
02.12.2021 17:25:17,821 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 386
02.12.2021 17:25:17,818 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118964ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:17,831 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:17,869 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59679ms for 60000ms of delay, sleeping for 331ms
02.12.2021 17:25:17,894 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:17,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,905 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,906 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:17,908 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,911 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:17,922 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 286
02.12.2021 17:25:17,932 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:18,022 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 185
02.12.2021 17:25:18,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:18,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,026 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,027 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:18,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:18,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,071 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:18,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:18,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:18,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:18,072 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:18,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:18,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,097 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,097 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:18,122 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 85
02.12.2021 17:25:18,127 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:18,181 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:18,182 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:18,182 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=70) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8,group_instance_id=null}
02.12.2021 17:25:18,203 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59457ms for 60000ms of delay, sleeping for 553ms
02.12.2021 17:25:18,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,211 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,213 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:18,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,225 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,227 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:18,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:18,283 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=70): org.apache.kafka.common.requests.HeartbeatResponse@459e4099
02.12.2021 17:25:18,283 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:18,314 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:18,328 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:18,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:18,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,411 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,412 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,412 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:18,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:18,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:18,429 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:18,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:18,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:18,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,527 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:18,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:18,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,573 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:18,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:18,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:18,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:18,573 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:18,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,598 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,598 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:18,616 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:18,628 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:18,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:18,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,715 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,715 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:18,728 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:18,728 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:18,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,731 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,731 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:18,760 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59715ms for 60000ms of delay, sleeping for 295ms
02.12.2021 17:25:18,815 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:18,823 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119969ms delay out of 120000ms. Remaining 31ms. Executor queue at 0
02.12.2021 17:25:18,823 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119959ms for 120000ms of delay, sleeping for 51ms
02.12.2021 17:25:18,831 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:18,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 10 records with 28 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:18,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 80397ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:18,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:18,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 29 iterations.
02.12.2021 17:25:18,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 0 records with 29 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:18,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 80397ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:18,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:18,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:18,876 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:18,876 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:18,876 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:18,876 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 123, -60, 27, -87, -99, 46, 69, 70, -123, -109, 86, 85, 111, -45, 14, -12, 0, 0, 0, 0, 0, 0, 0, 0, 20, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 8])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:18,877 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=57) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:18,877 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1001723, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:18,877 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1001733, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:18,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:18,877 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] task [0_8] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-8, new queue size is 10
02.12.2021 17:25:18,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,877 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:18,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 29 iterations.
02.12.2021 17:25:18,878 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119915ms for 120000ms of delay, sleeping for 95ms
02.12.2021 17:25:18,879 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:18,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,913 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,913 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:18,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:18,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,914 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,914 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:18,916 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:18,931 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:18,975 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119868ms for 120000ms of delay, sleeping for 142ms
02.12.2021 17:25:19,016 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:19,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,028 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,028 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:19,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 10 records with 15 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:19,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 16 iterations.
02.12.2021 17:25:19,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 0 records with 16 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:19,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:19,059 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1140684, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:19,059 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1140694, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:19,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:19,059 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-3, new queue size is 10
02.12.2021 17:25:19,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,059 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:19,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 16 iterations.
02.12.2021 17:25:19,060 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59613ms for 60000ms of delay, sleeping for 397ms
02.12.2021 17:25:19,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,074 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:19,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:19,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:19,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:19,074 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:19,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,099 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,099 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:19,116 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:19,119 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119862ms for 120000ms of delay, sleeping for 148ms
02.12.2021 17:25:19,128 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:19,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:19,216 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,216 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,216 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,216 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,216 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,216 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,216 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,216 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:19,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:19,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,232 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,232 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:19,269 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119007ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:19,316 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:19,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:19,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,414 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:19,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,415 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:19,417 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:19,429 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:19,460 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59388ms for 60000ms of delay, sleeping for 622ms
02.12.2021 17:25:19,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:19,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,530 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,532 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:19,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,575 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:19,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:19,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,578 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:19,578 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:19,580 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:19,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,600 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,601 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:19,619 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:19,633 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:19,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:19,738 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,738 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,738 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,738 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,738 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,734 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:19,734 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:19,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,744 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,744 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:19,742 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 499
02.12.2021 17:25:19,844 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 188
02.12.2021 17:25:19,854 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 387
02.12.2021 17:25:19,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,916 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,917 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,917 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,917 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:19,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:19,917 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,917 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,917 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,917 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,917 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,919 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:19,955 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 77
02.12.2021 17:25:19,960 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 281
02.12.2021 17:25:20,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:20,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,032 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 158
02.12.2021 17:25:20,060 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 181
02.12.2021 17:25:20,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:20,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,080 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:20,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:20,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:20,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:20,081 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:20,085 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59957ms for 60000ms of delay, sleeping for 53ms
02.12.2021 17:25:20,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:20,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,101 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,102 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:20,132 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 58
02.12.2021 17:25:20,139 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59956ms for 60000ms of delay, sleeping for 54ms
02.12.2021 17:25:20,161 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 80
02.12.2021 17:25:20,191 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:20,191 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:20,191 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=60) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42,group_instance_id=null}
02.12.2021 17:25:20,191 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,192 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=60): org.apache.kafka.common.requests.HeartbeatResponse@1db76a8d
02.12.2021 17:25:20,192 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:20,192 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 340
02.12.2021 17:25:20,192 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 340
02.12.2021 17:25:20,205 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59983ms for 60000ms of delay, sleeping for 27ms
02.12.2021 17:25:20,238 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59472ms for 60000ms of delay, sleeping for 538ms
02.12.2021 17:25:20,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,242 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:20,242 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,242 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,242 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,242 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,242 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,242 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,242 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,242 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:20,242 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:20,242 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=60) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422,group_instance_id=null}
02.12.2021 17:25:20,242 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:20,242 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=60): org.apache.kafka.common.requests.HeartbeatResponse@277d1e4e
02.12.2021 17:25:20,243 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:20,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 499
02.12.2021 17:25:20,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 499
02.12.2021 17:25:20,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:20,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,244 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:20,271 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118175ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:20,292 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 240
02.12.2021 17:25:20,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:20,392 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 140
02.12.2021 17:25:20,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:20,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,417 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,418 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:20,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:20,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,420 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,421 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:20,444 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:20,493 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 39
02.12.2021 17:25:20,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:20,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,532 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,532 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:20,545 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:20,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:20,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,582 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:20,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:20,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:20,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:20,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:20,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,603 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,603 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:20,632 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:20,645 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:20,733 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:20,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:20,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,745 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:20,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,747 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,747 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,750 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,750 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,750 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,750 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,750 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,750 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,751 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:20,750 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:20,777 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59921ms for 60000ms of delay, sleeping for 89ms
02.12.2021 17:25:20,835 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:20,854 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 396
02.12.2021 17:25:20,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 10 records with 16 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:20,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 17 iterations.
02.12.2021 17:25:20,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 0 records with 17 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:20,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:20,868 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1140694, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:20,868 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1140704, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:20,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:20,868 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-3, new queue size is 10
02.12.2021 17:25:20,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,868 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:20,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 17 iterations.
02.12.2021 17:25:20,869 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59835ms for 60000ms of delay, sleeping for 175ms
02.12.2021 17:25:20,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:20,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,919 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,919 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,919 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,919 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,919 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,919 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,919 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:20,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:20,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,923 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:20,935 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:20,955 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:21,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,033 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:21,045 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59217ms for 60000ms of delay, sleeping for 793ms
02.12.2021 17:25:21,055 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:21,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,083 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:21,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:21,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:21,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:21,084 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:21,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,104 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,104 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:21,133 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:21,155 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:21,188 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:21,188 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:21,188 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=71) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8,group_instance_id=null}
02.12.2021 17:25:21,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:21,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:21,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,250 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,250 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:21,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:21,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,251 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,251 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:21,271 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119175ms delay out of 120000ms. Remaining 825ms. Executor queue at 0
02.12.2021 17:25:21,275 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119056ms for 120000ms of delay, sleeping for 954ms
02.12.2021 17:25:21,288 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=71): org.apache.kafka.common.requests.HeartbeatResponse@36b6e8e
02.12.2021 17:25:21,288 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:21,334 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:21,351 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:21,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:21,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,419 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,420 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:21,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,424 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,424 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:21,434 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:21,452 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:21,534 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,534 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,534 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,534 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,534 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,534 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,534 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,534 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,534 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:21,552 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:21,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:21,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,589 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:21,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:21,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:21,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:21,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:21,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,607 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,607 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,607 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,607 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,607 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,607 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,607 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:21,635 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:21,663 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 88
02.12.2021 17:25:21,735 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:21,750 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:21,750 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,751 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,751 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:21,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 519 ms and fetched 0 records
02.12.2021 17:25:21,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,778 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,778 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:21,846 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59799ms for 60000ms of delay, sleeping for 211ms
02.12.2021 17:25:21,850 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 184
02.12.2021 17:25:21,876 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=45): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', members=[])
02.12.2021 17:25:21,876 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', members=[])
02.12.2021 17:25:21,876 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:21,876 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=57, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', protocol='stream'}
02.12.2021 17:25:21,877 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=57, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=57, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:21,877 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=46) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d,group_instance_id=null,assignments=[]}
02.12.2021 17:25:21,877 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 214
02.12.2021 17:25:21,878 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=64): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', members=[])
02.12.2021 17:25:21,883 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 395
02.12.2021 17:25:21,878 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', members=[])
02.12.2021 17:25:21,886 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:21,886 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=57, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', protocol='stream'}
02.12.2021 17:25:21,887 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=57, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=57, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:21,887 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=65) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b,group_instance_id=null,assignments=[]}
02.12.2021 17:25:21,876 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=64): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', members=[])
02.12.2021 17:25:21,888 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', members=[])
02.12.2021 17:25:21,893 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:21,887 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 220
02.12.2021 17:25:21,893 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=57, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', protocol='stream'}
02.12.2021 17:25:21,899 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=57, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=57, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:21,902 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=65) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21,group_instance_id=null,assignments=[]}
02.12.2021 17:25:21,906 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 345
02.12.2021 17:25:21,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:21,921 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,921 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,925 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,926 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,926 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,926 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,928 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:21,926 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,931 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:21,950 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 84
02.12.2021 17:25:21,984 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:22,010 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=65): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,010 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,010 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=65): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,010 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=46): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])
02.12.2021 17:25:22,011 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])
02.12.2021 17:25:22,011 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=57, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', protocol='stream'}
02.12.2021 17:25:22,011 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 57 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21
02.12.2021 17:25:22,011 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:22,011 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:22,011 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:22,012 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:22,012 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:22,012 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906] State transition from RUNNING to REBALANCING
02.12.2021 17:25:22,012 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:22,012 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 241
02.12.2021 17:25:22,010 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,012 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=57, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', protocol='stream'}
02.12.2021 17:25:22,012 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 57 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b
02.12.2021 17:25:22,011 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=57, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', protocol='stream'}
02.12.2021 17:25:22,013 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 57 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d
02.12.2021 17:25:22,012 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:22,013 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:22,013 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:22,013 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:22,014 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:22,013 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:22,014 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:22,014 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:22,015 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:22,014 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1474] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer] Requested to schedule immediate rebalance for new tasks to be safely revoked from current owner.
02.12.2021 17:25:22,015 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:22,015 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:22,015 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:22,015 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 80
02.12.2021 17:25:22,038 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:22,038 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,038 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,038 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,038 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,038 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,038 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,038 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,038 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:22,060 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59951ms for 60000ms of delay, sleeping for 59ms
02.12.2021 17:25:22,086 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:22,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:22,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:22,096 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Transiting to restore active tasks: {}
02.12.2021 17:25:22,096 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:22,096 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Paused partitions [] from the restore consumer
02.12.2021 17:25:22,096 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:22,096 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Transiting to update standby tasks: {}
02.12.2021 17:25:22,096 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:22,096 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Resumed partitions [] from the restore consumer
02.12.2021 17:25:22,096 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:22,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Initialization call done. State is RUNNING
02.12.2021 17:25:22,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,096 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:22,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:22,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:22,096 INFO [org.apache.kafka.streams.processor.internals.StreamThread:555] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Triggering the followup rebalance scheduled for 0 ms.
02.12.2021 17:25:22,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:22,096 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 57 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d
02.12.2021 17:25:22,096 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:22,096 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:22,097 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 70, -39, -14, -119, 6, 48, 75, 25, -73, -14, -59, -98, 2, 41, -103, 6, 0, 0, 0, 0, 0, 0, 0, 0, 22, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:22,097 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=47) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:22,097 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:22,111 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:22,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:22,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:22,112 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:22,112 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 139
02.12.2021 17:25:22,112 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:22,113 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:22,113 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:22,113 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:22,113 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:22,113 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:22,113 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:22,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:22,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,113 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:22,128 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59392ms for 60000ms of delay, sleeping for 618ms
02.12.2021 17:25:22,138 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:22,186 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:22,213 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 38
02.12.2021 17:25:22,214 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:22,231 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119851ms for 120000ms of delay, sleeping for 159ms
02.12.2021 17:25:22,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:22,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:22,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:22,251 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:22,251 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:22,252 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:22,252 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:22,252 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:22,252 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:22,252 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:22,252 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:22,252 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906] State transition from REBALANCING to RUNNING
02.12.2021 17:25:22,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:22,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,253 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,253 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:22,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,279 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,279 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:22,314 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:22,339 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:22,353 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:22,368 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=61): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', members=[])
02.12.2021 17:25:22,369 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', members=[])
02.12.2021 17:25:22,369 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:22,369 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=61): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', members=[])
02.12.2021 17:25:22,369 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', members=[])
02.12.2021 17:25:22,369 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:22,369 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=188, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', protocol='stream'}
02.12.2021 17:25:22,370 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=188, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=188, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:22,370 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=62) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf,group_instance_id=null,assignments=[]}
02.12.2021 17:25:22,369 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=188, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', protocol='stream'}
02.12.2021 17:25:22,370 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 58
02.12.2021 17:25:22,370 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=188, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=188, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:22,370 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=62) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82,group_instance_id=null,assignments=[]}
02.12.2021 17:25:22,371 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 61
02.12.2021 17:25:22,379 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:22,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 10 records with 29 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:22,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 83913ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:22,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:22,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 30 iterations.
02.12.2021 17:25:22,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 0 records with 30 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:22,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 83913ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:22,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:22,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:22,393 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=57): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', members=[])
02.12.2021 17:25:22,394 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', members=[])
02.12.2021 17:25:22,395 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:22,395 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=188, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', protocol='stream'}
02.12.2021 17:25:22,395 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=188, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=188, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:22,395 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1001733, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:22,395 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1001743, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:22,395 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=58) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336,group_instance_id=null,assignments=[]}
02.12.2021 17:25:22,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Main Consumer poll completed in 4 ms and fetched 10 records
02.12.2021 17:25:22,396 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] task [0_8] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-8, new queue size is 10
02.12.2021 17:25:22,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,396 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:22,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 30 iterations.
02.12.2021 17:25:22,397 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119210ms for 120000ms of delay, sleeping for 800ms
02.12.2021 17:25:22,406 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=62): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,407 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,407 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=188, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', protocol='stream'}
02.12.2021 17:25:22,407 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 188 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82
02.12.2021 17:25:22,407 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=62): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,408 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,408 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:22,408 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:22,408 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=188, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', protocol='stream'}
02.12.2021 17:25:22,409 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 188 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf
02.12.2021 17:25:22,409 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:22,409 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:22,409 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:22,409 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:22,409 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:22,409 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:22,410 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4] State transition from RUNNING to REBALANCING
02.12.2021 17:25:22,410 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:22,410 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:22,410 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:22,410 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 24
02.12.2021 17:25:22,410 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:22,411 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 20
02.12.2021 17:25:22,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 200
02.12.2021 17:25:22,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:22,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:22,431 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:22,431 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:22,431 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:22,431 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:22,431 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:22,431 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:22,431 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:22,431 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:22,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:22,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,432 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,432 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:22,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:22,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:22,435 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:22,435 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:22,435 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:22,435 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:22,435 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:22,435 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:22,435 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:22,435 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:22,435 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4] State transition from REBALANCING to RUNNING
02.12.2021 17:25:22,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:22,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,435 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,435 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:22,439 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:22,453 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:22,480 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:22,496 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=58): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 8, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,496 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 8, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,496 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=188, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', protocol='stream'}
02.12.2021 17:25:22,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:22,532 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:22,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:22,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:22,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,540 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,540 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:22,554 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:22,580 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:22,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,597 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:22,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:22,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:22,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:22,597 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:22,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,614 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,615 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:22,633 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:22,636 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:22,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:22,655 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:22,680 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:22,715 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:22,733 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:22,737 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:22,741 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:22,751 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59703ms for 60000ms of delay, sleeping for 307ms
02.12.2021 17:25:22,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:22,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,758 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,759 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,759 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,759 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,759 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,759 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,759 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:22,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,780 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,780 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 462
02.12.2021 17:25:22,816 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:22,837 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:22,839 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:22,842 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:22,859 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:22,880 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 362
02.12.2021 17:25:22,916 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:22,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,933 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,933 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:22,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,936 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,936 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:22,942 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:22,959 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:22,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 261
02.12.2021 17:25:23,016 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:23,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:23,036 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:23,041 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:23,041 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,041 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,041 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,041 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,041 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,041 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,041 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,041 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 150
02.12.2021 17:25:23,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 200
02.12.2021 17:25:23,063 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59975ms for 60000ms of delay, sleeping for 35ms
02.12.2021 17:25:23,081 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 161
02.12.2021 17:25:23,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:23,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,098 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:23,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:23,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:23,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:23,098 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:23,100 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59939ms for 60000ms of delay, sleeping for 71ms
02.12.2021 17:25:23,115 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:23,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,116 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,116 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:23,134 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:23,137 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:23,141 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 50
02.12.2021 17:25:23,160 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:23,172 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59843ms for 60000ms of delay, sleeping for 167ms
02.12.2021 17:25:23,181 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 61
02.12.2021 17:25:23,192 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:23,192 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:23,192 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=61) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42,group_instance_id=null}
02.12.2021 17:25:23,192 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 348
02.12.2021 17:25:23,193 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=61): org.apache.kafka.common.requests.HeartbeatResponse@69e82c68
02.12.2021 17:25:23,193 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:23,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 348
02.12.2021 17:25:23,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 347
02.12.2021 17:25:23,201 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119254ms for 120000ms of delay, sleeping for 756ms
02.12.2021 17:25:23,216 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:23,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:23,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:23,242 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,242 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,246 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,246 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,246 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,246 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:23,246 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:23,246 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=61) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422,group_instance_id=null}
02.12.2021 17:25:23,246 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 34
02.12.2021 17:25:23,247 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=61): org.apache.kafka.common.requests.HeartbeatResponse@2d8b87a5
02.12.2021 17:25:23,247 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:23,247 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 33
02.12.2021 17:25:23,247 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 33
02.12.2021 17:25:23,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:23,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,260 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:23,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:23,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,280 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:23,295 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 246
02.12.2021 17:25:23,316 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:23,335 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:23,339 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:23,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 10 records with 17 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:23,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 31485ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:23,341 DEBUG [org.apache.kafka.streams.processor.internals.RecordCollectorImpl:247] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] task [0_3] Flushing record collector
02.12.2021 17:25:23,343 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:381] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] task [0_3] Prepared RUNNING task for committing
02.12.2021 17:25:23,343 TRACE [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1157] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending OffsetCommit request with {redacted.Cloud.Message.Callback.Retry1-3=OffsetAndMetadata{offset=1140704, leaderEpoch=null, metadata='AQAAAX179hAh'}} to coordinator kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:23,344 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending OFFSET_COMMIT request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=72) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8,group_instance_id=null,topics=[{name=redacted.Cloud.Message.Callback.Retry1,partitions=[{partition_index=3,committed_offset=1140704,committed_leader_epoch=-1,committed_metadata=AQAAAX179hAh}]}]}
02.12.2021 17:25:23,357 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received OFFSET_COMMIT response from node 2147483644 for request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=72): OffsetCommitResponseData(throttleTimeMs=0, topics=[OffsetCommitResponseTopic(name='redacted.Cloud.Message.Callback.Retry1', partitions=[OffsetCommitResponsePartition(partitionIndex=3, errorCode=0)])])
02.12.2021 17:25:23,357 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1185] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Committed offset 1140704 for partition redacted.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:23,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:808] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] task [0_3] Checkpointable offsets {redacted.Cloud.Message.Callback.Retry1-3=1140703}
02.12.2021 17:25:23,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:465] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] task [0_3] Finalized commit for RUNNING task with eos false enforce checkpoint false
02.12.2021 17:25:23,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:684] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Committed all active tasks [0_3] and standby tasks [] in 0ms
02.12.2021 17:25:23,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 8 iterations.
02.12.2021 17:25:23,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 0 records with 8 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:23,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:23,358 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1140704, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:23,358 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1140714, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:23,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:23,358 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-3, new queue size is 10
02.12.2021 17:25:23,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,358 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:23,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 8 iterations.
02.12.2021 17:25:23,359 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58657ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:23,360 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:23,381 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:23,395 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 146
02.12.2021 17:25:23,417 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:23,434 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:23,434 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,434 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,434 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,434 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,434 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,434 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,434 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,434 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:23,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:23,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,436 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,436 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:23,461 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:23,482 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:23,496 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 45
02.12.2021 17:25:23,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:23,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:23,537 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:23,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:23,542 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,542 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,542 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,543 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,543 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,543 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,543 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,543 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:23,562 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:23,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:23,599 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:23,599 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,599 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:23,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:23,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:23,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:23,604 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:23,617 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:23,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,619 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,622 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:23,635 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:23,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:23,644 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:23,662 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:23,683 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:23,724 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 398
02.12.2021 17:25:23,736 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:23,740 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:23,744 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:23,764 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:23,764 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,765 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,768 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,768 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,770 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:23,782 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:23,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,785 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,785 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:23,839 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:23,846 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 91
02.12.2021 17:25:23,824 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:23,854 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:23,887 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:23,876 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 396
02.12.2021 17:25:23,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:23,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,934 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,935 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:23,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:23,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,937 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,937 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:23,949 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 173
02.12.2021 17:25:23,960 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119822ms for 120000ms of delay, sleeping for 188ms
02.12.2021 17:25:23,974 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 73
02.12.2021 17:25:23,987 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:23,987 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 283
02.12.2021 17:25:24,035 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:24,038 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:24,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:24,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,047 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,047 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:24,049 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 73
02.12.2021 17:25:24,087 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:24,088 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 182
02.12.2021 17:25:24,105 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:24,105 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,105 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:24,105 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,105 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:24,105 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,105 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:24,105 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:24,105 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:24,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:24,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,123 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,123 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:24,135 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:24,138 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:24,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:24,149 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118106ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:24,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 82
02.12.2021 17:25:24,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:24,194 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:24,194 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:24,195 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=73) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8,group_instance_id=null}
02.12.2021 17:25:24,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:24,236 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:24,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:24,248 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:24,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:24,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,271 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:24,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:24,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,286 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,286 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:24,295 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=73): org.apache.kafka.common.requests.HeartbeatResponse@743f18ca
02.12.2021 17:25:24,295 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:24,327 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:24,336 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:24,339 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:24,349 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:24,359 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59657ms delay out of 60000ms. Remaining 343ms. Executor queue at 0
02.12.2021 17:25:24,360 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59580ms for 60000ms of delay, sleeping for 430ms
02.12.2021 17:25:24,372 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:24,386 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:24,427 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:24,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:24,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,437 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,437 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,437 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,437 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,437 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,437 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,437 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:24,437 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:24,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,439 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,440 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:24,449 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:24,472 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:24,487 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:24,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:24,538 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:24,541 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:24,547 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:24,547 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,548 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,548 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:24,573 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:24,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:24,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:24,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,606 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:24,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:24,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:24,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:24,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:24,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:24,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,624 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,624 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 262
02.12.2021 17:25:24,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:24,641 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:24,648 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:24,674 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:24,687 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:24,725 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 161
02.12.2021 17:25:24,738 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:24,741 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:24,748 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:24,771 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:24,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,772 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 120
02.12.2021 17:25:24,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:24,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,787 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,787 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:24,791 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59899ms for 60000ms of delay, sleeping for 111ms
02.12.2021 17:25:24,825 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 61
02.12.2021 17:25:24,838 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:24,842 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:24,852 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:24,873 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 20
02.12.2021 17:25:24,886 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:24,886 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:24,886 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:24,887 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:24,887 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:24,887 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 57 and member id staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:24,887 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=66) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b,group_instance_id=null}
02.12.2021 17:25:24,887 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 237
02.12.2021 17:25:24,887 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=66): org.apache.kafka.common.requests.HeartbeatResponse@7556904a
02.12.2021 17:25:24,887 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:24,887 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 57 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b
02.12.2021 17:25:24,887 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:24,888 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:24,888 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:24,888 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 70, -39, -14, -119, 6, 48, 75, 25, -73, -14, -59, -98, 2, 41, -103, 6, 0, 0, 0, 0, 0, 0, 0, 0, 22, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:24,888 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=67) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:24,888 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 236
02.12.2021 17:25:24,894 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:24,894 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:24,894 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:24,894 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 57 and member id staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:24,894 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=66) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21,group_instance_id=null}
02.12.2021 17:25:24,894 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 379
02.12.2021 17:25:24,894 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=66): org.apache.kafka.common.requests.HeartbeatResponse@385cc269
02.12.2021 17:25:24,894 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:24,894 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 57 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21
02.12.2021 17:25:24,895 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:24,895 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:24,895 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 70, -39, -14, -119, 6, 48, 75, 25, -73, -14, -59, -98, 2, 41, -103, 6, 0, 0, 0, 0, 0, 0, 0, 0, 22, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:24,895 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=67) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:24,895 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 378
02.12.2021 17:25:24,905 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59729ms for 60000ms of delay, sleeping for 281ms
02.12.2021 17:25:24,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:24,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,938 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,938 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 431
02.12.2021 17:25:24,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:24,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,942 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,942 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 427
02.12.2021 17:25:24,952 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:24,987 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:24,988 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:24,994 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:25,038 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 331
02.12.2021 17:25:25,043 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 326
02.12.2021 17:25:25,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:25,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,049 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,049 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:25,088 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:25,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:25,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,107 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:25,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:25,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:25,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Committing all active tasks [] and standby tasks [] since 30130ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:25,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:25,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:25,107 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:25,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:25,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,125 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30157ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:25,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:25,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,125 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:25,139 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 230
02.12.2021 17:25:25,143 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 226
02.12.2021 17:25:25,149 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119106ms delay out of 120000ms. Remaining 894ms. Executor queue at 0
02.12.2021 17:25:25,149 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:25,150 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118940ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:25,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:25,192 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59965ms for 60000ms of delay, sleeping for 45ms
02.12.2021 17:25:25,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 130
02.12.2021 17:25:25,240 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59537ms for 60000ms of delay, sleeping for 473ms
02.12.2021 17:25:25,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 126
02.12.2021 17:25:25,250 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:25,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:25,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,274 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30209ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:25,275 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:25,275 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,275 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:25,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:25,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,288 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,289 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:25,339 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 30
02.12.2021 17:25:25,344 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 26
02.12.2021 17:25:25,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:25,370 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,370 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,370 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,370 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:25,370 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 188 and member id staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:25,370 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=63) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82,group_instance_id=null}
02.12.2021 17:25:25,372 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:25,372 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 72
02.12.2021 17:25:25,372 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=63): org.apache.kafka.common.requests.HeartbeatResponse@55cfa12c
02.12.2021 17:25:25,372 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:25,372 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 188 and member id staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:25,373 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=63) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf,group_instance_id=null}
02.12.2021 17:25:25,372 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,373 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 65
02.12.2021 17:25:25,374 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=63): org.apache.kafka.common.requests.HeartbeatResponse@26a85163
02.12.2021 17:25:25,374 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:25,372 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 188 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82
02.12.2021 17:25:25,374 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:25,374 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 188 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf
02.12.2021 17:25:25,374 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:25,374 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:25,375 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 123, -60, 27, -87, -99, 46, 69, 70, -123, -109, 86, 85, 111, -45, 14, -12, 0, 0, 0, 0, 0, 0, 0, 0, 21, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:25,375 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:25,376 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 123, -60, 27, -87, -99, 46, 69, 70, -123, -109, 86, 85, 111, -45, 14, -12, 0, 0, 0, 0, 0, 0, 0, 0, 21, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:25,376 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=64) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:25,376 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 62
02.12.2021 17:25:25,375 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=64) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:25,377 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 65
02.12.2021 17:25:25,391 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:25,400 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:25,400 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 188 and member id staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:25,400 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=59) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336,group_instance_id=null}
02.12.2021 17:25:25,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:25,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,439 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,439 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:25,442 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:25,442 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,442 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,442 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,442 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,442 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,443 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:25,451 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:25,472 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:25,473 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:25,491 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:25,501 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=59): org.apache.kafka.common.requests.HeartbeatResponse@7730c33e
02.12.2021 17:25:25,501 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:25,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:25,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,550 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,553 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:25,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:25,608 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:25,608 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,609 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:25,609 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,609 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:25,609 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,609 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:25,609 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Committing all active tasks [] and standby tasks [] since 30632ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:25,609 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:25,609 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:25,609 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:25,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:25,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,626 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30660ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:25,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:25,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,629 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:25,653 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:25,692 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:25,719 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59755ms for 60000ms of delay, sleeping for 255ms
02.12.2021 17:25:25,754 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:25,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:25,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,775 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,776 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,776 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,776 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30711ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:25,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:25,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,780 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:25,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:25,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,790 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,791 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 455
02.12.2021 17:25:25,863 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:25,898 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 348
02.12.2021 17:25:25,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:25,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,941 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,941 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:25,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:25,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,944 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,945 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:25,965 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 88
02.12.2021 17:25:25,981 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58132ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:25,998 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 248
02.12.2021 17:25:26,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,054 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,054 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 138
02.12.2021 17:25:26,098 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 148
02.12.2021 17:25:26,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,111 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:26,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:26,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:26,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Committing all active tasks [] and standby tasks [] since 31134ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:26,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:26,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:26,111 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:26,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,130 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Committing all active tasks [] and standby tasks [] since 31162ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:26,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:26,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,131 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:26,150 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119940ms delay out of 120000ms. Remaining 60ms. Executor queue at 0
02.12.2021 17:25:26,151 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119272ms for 120000ms of delay, sleeping for 738ms
02.12.2021 17:25:26,154 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 38
02.12.2021 17:25:26,192 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:26,193 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:26,193 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=62) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42,group_instance_id=null}
02.12.2021 17:25:26,192 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 361
02.12.2021 17:25:26,195 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=62): org.apache.kafka.common.requests.HeartbeatResponse@304cd27f
02.12.2021 17:25:26,195 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:26,195 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 359
02.12.2021 17:25:26,195 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 359
02.12.2021 17:25:26,201 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 45
02.12.2021 17:25:26,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,262 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:26,263 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:26,263 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=62) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422,group_instance_id=null}
02.12.2021 17:25:26,263 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 29
02.12.2021 17:25:26,268 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=62): org.apache.kafka.common.requests.HeartbeatResponse@5c9d3f31
02.12.2021 17:25:26,268 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:26,269 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 23
02.12.2021 17:25:26,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 21
02.12.2021 17:25:26,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:26,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,283 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Committing all active tasks [] and standby tasks [] since 31219ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:26,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:26,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,284 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:26,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,292 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,292 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:26,296 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 258
02.12.2021 17:25:26,393 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:26,397 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 157
02.12.2021 17:25:26,442 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,443 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,443 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:26,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:26,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,446 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,446 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:26,493 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:26,497 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 57
02.12.2021 17:25:26,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,555 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,555 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:26,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:26,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:26,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,612 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:26,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:26,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:26,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Committing all active tasks [] and standby tasks [] since 31635ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:26,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:26,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:26,612 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:26,632 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,632 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,632 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,632 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,632 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,632 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,632 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,632 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Committing all active tasks [] and standby tasks [] since 31664ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:26,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:26,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,633 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:26,656 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:26,694 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:26,756 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:26,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,785 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Committing all active tasks [] and standby tasks [] since 31721ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:26,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:26,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,788 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:26,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:26,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,795 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,795 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:26,857 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:26,892 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119549ms for 120000ms of delay, sleeping for 461ms
02.12.2021 17:25:26,896 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:26,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:26,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,944 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,944 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:26,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,947 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,947 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:26,957 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:26,981 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59132ms delay out of 60000ms. Remaining 868ms. Executor queue at 0
02.12.2021 17:25:26,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 8 records with 8 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:26,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 9 iterations.
02.12.2021 17:25:26,982 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58911ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:26,996 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:27,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,056 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,056 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:27,096 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:27,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,113 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:27,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:27,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:27,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Committing all active tasks [] and standby tasks [] since 32137ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:27,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:27,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:27,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:27,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,134 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Committing all active tasks [] and standby tasks [] since 32166ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:27,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:27,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,134 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:27,156 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:27,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:27,202 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:27,202 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:27,202 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=74) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8,group_instance_id=null}
02.12.2021 17:25:27,257 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:27,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:27,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,290 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Committing all active tasks [] and standby tasks [] since 32225ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:27,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:27,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:27,299 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:27,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,300 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,300 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:27,303 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=74): org.apache.kafka.common.requests.HeartbeatResponse@1ac67d8
02.12.2021 17:25:27,303 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:27,357 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:27,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 10 records with 30 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:27,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 88884ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:27,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:27,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 31 iterations.
02.12.2021 17:25:27,364 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 0 records with 31 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,364 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:27,364 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 88885ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:27,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:27,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:27,365 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 188 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336
02.12.2021 17:25:27,365 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:27,366 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[redacted.Cloud.Message.Callback.Retry2-8], userDataSize=48)
02.12.2021 17:25:27,367 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:27,369 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:330] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] task [0_8] Skip resuming since state is RUNNING
02.12.2021 17:25:27,369 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:27,369 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:27,369 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4] State transition from RUNNING to REBALANCING
02.12.2021 17:25:27,369 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Pausing partitions [redacted.Cloud.Message.Callback.Retry2-8]
02.12.2021 17:25:27,369 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 188 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336
02.12.2021 17:25:27,369 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:27,369 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:27,370 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 123, -60, 27, -87, -99, 46, 69, 70, -123, -109, 86, 85, 111, -45, 14, -12, 0, 0, 0, 0, 0, 0, 0, 0, 21, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 8])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:27,370 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=60) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:27,371 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry2-8 because it is paused
02.12.2021 17:25:27,371 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 494
02.12.2021 17:25:27,400 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:27,404 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:27,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,446 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:27,447 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:27,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,449 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,449 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:27,460 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:27,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:27,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:27,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,556 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,558 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:27,604 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:27,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,616 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:27,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:27,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:27,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Committing all active tasks [] and standby tasks [] since 32639ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:27,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:27,617 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:27,617 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:27,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,635 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Committing all active tasks [] and standby tasks [] since 32667ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:27,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:27,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,635 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:27,658 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:27,705 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:27,761 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:27,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,791 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Committing all active tasks [] and standby tasks [] since 32726ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:27,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:27,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,803 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:27,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:27,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,805 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:27,861 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:27,867 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry2-8 because it is paused
02.12.2021 17:25:27,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:27,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:27,867 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Transiting to restore active tasks: {}
02.12.2021 17:25:27,867 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:27,867 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Paused partitions [] from the restore consumer
02.12.2021 17:25:27,867 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Resuming partitions [redacted.Cloud.Message.Callback.Retry2-8]
02.12.2021 17:25:27,867 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Transiting to update standby tasks: {}
02.12.2021 17:25:27,867 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:27,867 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Resumed partitions [] from the restore consumer
02.12.2021 17:25:27,867 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:27,867 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4] State transition from REBALANCING to RUNNING
02.12.2021 17:25:27,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Initialization call done. State is RUNNING
02.12.2021 17:25:27,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,868 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:27,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 31 iterations.
02.12.2021 17:25:27,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 0 records with 31 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:27,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 89389ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:27,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:27,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:27,868 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1001743, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:27,868 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1001753, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:27,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:27,868 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] task [0_8] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-8, new queue size is 10
02.12.2021 17:25:27,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,868 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:27,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 31 iterations.
02.12.2021 17:25:27,872 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119693ms for 120000ms of delay, sleeping for 317ms
02.12.2021 17:25:27,910 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:27,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:27,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,949 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30301ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:27,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:27,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,952 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30145ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:27,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:27,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,953 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:27,952 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:27,966 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:27,982 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59911ms delay out of 60000ms. Remaining 89ms. Executor queue at 0
02.12.2021 17:25:27,983 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59893ms for 60000ms of delay, sleeping for 117ms
02.12.2021 17:25:28,011 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:28,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:28,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,059 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:28,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 2 records with 9 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:28,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 10 iterations.
02.12.2021 17:25:28,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 0 records with 10 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:28,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:28,102 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1140714, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:28,102 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1140724, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:28,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:28,102 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-3, new queue size is 10
02.12.2021 17:25:28,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,102 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:28,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 10 iterations.
02.12.2021 17:25:28,103 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59080ms for 60000ms of delay, sleeping for 930ms
02.12.2021 17:25:28,111 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:28,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:28,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,117 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:28,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:28,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:28,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Committing all active tasks [] and standby tasks [] since 33140ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:28,118 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:28,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,139 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,139 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,139 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,139 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,139 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,139 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Committing all active tasks [] and standby tasks [] since 33171ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,139 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,140 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:28,159 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:28,200 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119365ms for 120000ms of delay, sleeping for 645ms
02.12.2021 17:25:28,211 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:28,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:28,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:28,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,304 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Committing all active tasks [] and standby tasks [] since 33239ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,304 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:28,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:28,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,310 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,310 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:28,360 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:28,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:28,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:28,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,457 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30808ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,457 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:28,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:28,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,458 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30651ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,458 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:28,460 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:28,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 291
02.12.2021 17:25:28,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:28,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,565 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,565 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:28,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,618 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:28,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:28,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:28,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Committing all active tasks [] and standby tasks [] since 33641ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:28,619 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:28,620 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:28,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,641 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,642 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Committing all active tasks [] and standby tasks [] since 33673ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,642 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,642 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,642 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:28,666 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:28,721 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:28,766 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:28,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:28,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,805 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Committing all active tasks [] and standby tasks [] since 33740ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,806 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:28,815 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:28,815 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,815 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,815 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,815 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,815 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,815 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,815 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,815 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 447
02.12.2021 17:25:28,847 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119956ms for 120000ms of delay, sleeping for 54ms
02.12.2021 17:25:28,871 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:28,903 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119866ms for 120000ms of delay, sleeping for 144ms
02.12.2021 17:25:28,916 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 347
02.12.2021 17:25:28,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,958 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Committing all active tasks [] and standby tasks [] since 31309ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,959 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:28,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,959 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Committing all active tasks [] and standby tasks [] since 31152ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,959 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:28,971 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:29,016 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 246
02.12.2021 17:25:29,035 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59976ms for 60000ms of delay, sleeping for 34ms
02.12.2021 17:25:29,048 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119154ms for 120000ms of delay, sleeping for 856ms
02.12.2021 17:25:29,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:29,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,065 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,066 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 126
02.12.2021 17:25:29,072 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59933ms for 60000ms of delay, sleeping for 77ms
02.12.2021 17:25:29,116 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 146
02.12.2021 17:25:29,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:29,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,119 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:29,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:29,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:29,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Committing all active tasks [] and standby tasks [] since 34142ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:29,120 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:29,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:29,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,143 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Committing all active tasks [] and standby tasks [] since 34175ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,143 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:29,151 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58191ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:29,166 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 26
02.12.2021 17:25:29,192 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:29,192 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:29,192 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:29,192 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:29,192 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:29,192 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:29,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:29,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:29,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:29,193 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:29,194 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:29,194 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=63) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42,group_instance_id=null}
02.12.2021 17:25:29,199 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 373
02.12.2021 17:25:29,200 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=63): org.apache.kafka.common.requests.HeartbeatResponse@97c600f
02.12.2021 17:25:29,201 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:29,202 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 365
02.12.2021 17:25:29,203 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 363
02.12.2021 17:25:29,216 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 46
02.12.2021 17:25:29,263 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:29,263 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:29,263 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:29,263 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:29,263 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:29,263 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:29,263 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=63) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422,group_instance_id=null}
02.12.2021 17:25:29,263 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 52
02.12.2021 17:25:29,263 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=63): org.apache.kafka.common.requests.HeartbeatResponse@687dc8f2
02.12.2021 17:25:29,264 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:29,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 52
02.12.2021 17:25:29,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 51
02.12.2021 17:25:29,304 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 263
02.12.2021 17:25:29,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,307 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Committing all active tasks [] and standby tasks [] since 34242ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,307 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:29,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:29,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,315 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,315 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:29,399 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=64): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', members=[])
02.12.2021 17:25:29,399 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', members=[])
02.12.2021 17:25:29,399 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=64): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', members=[])
02.12.2021 17:25:29,399 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', members=[])
02.12.2021 17:25:29,399 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:29,399 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:29,400 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=189, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', protocol='stream'}
02.12.2021 17:25:29,400 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=189, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', protocol='stream'}
02.12.2021 17:25:29,400 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=189, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=189, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:29,400 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=65) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf,group_instance_id=null,assignments=[]}
02.12.2021 17:25:29,401 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 58
02.12.2021 17:25:29,400 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=189, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=189, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:29,402 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=65) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82,group_instance_id=null,assignments=[]}
02.12.2021 17:25:29,403 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 56
02.12.2021 17:25:29,405 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 161
02.12.2021 17:25:29,416 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:29,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:29,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,459 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Committing all active tasks [] and standby tasks [] since 31810ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,459 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:29,459 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=65): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:29,460 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=65): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:29,460 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:29,460 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:29,460 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=189, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', protocol='stream'}
02.12.2021 17:25:29,460 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=189, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', protocol='stream'}
02.12.2021 17:25:29,460 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 189 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf
02.12.2021 17:25:29,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,460 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,460 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:29,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Committing all active tasks [] and standby tasks [] since 31653ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,460 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 189 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82
02.12.2021 17:25:29,460 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:29,461 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:29,461 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:29,461 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:29,461 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:29,461 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4] State transition from RUNNING to REBALANCING
02.12.2021 17:25:29,461 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:29,461 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 499
02.12.2021 17:25:29,461 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:29,462 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:29,464 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:29,464 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:29,465 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:29,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:29,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 61
02.12.2021 17:25:29,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:29,563 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 397
02.12.2021 17:25:29,566 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 395
02.12.2021 17:25:29,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,567 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,568 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:29,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:29,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,620 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:29,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:29,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:29,618 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:29,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Committing all active tasks [] and standby tasks [] since 34643ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:29,624 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:29,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,644 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Committing all active tasks [] and standby tasks [] since 34676ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,644 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:29,664 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 295
02.12.2021 17:25:29,666 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 294
02.12.2021 17:25:29,669 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:29,721 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:29,766 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 194
02.12.2021 17:25:29,766 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 193
02.12.2021 17:25:29,769 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:29,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:29,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:29,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,819 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,820 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,818 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,823 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,823 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,823 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,823 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,822 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:29,823 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Committing all active tasks [] and standby tasks [] since 34758ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,830 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:29,866 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 94
02.12.2021 17:25:29,869 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 90
02.12.2021 17:25:29,871 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:29,907 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118185ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:29,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:29,960 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,960 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:29,960 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:29,960 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:29,960 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:29,960 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:29,960 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:29,960 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:29,960 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:29,960 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:29,960 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:29,960 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,960 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,960 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,960 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,960 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Committing all active tasks [] and standby tasks [] since 32312ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,961 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:29,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:29,961 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:29,961 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:29,961 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:29,961 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:29,961 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:29,961 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:29,961 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:29,961 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:29,961 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4] State transition from REBALANCING to RUNNING
02.12.2021 17:25:29,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:29,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,961 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Committing all active tasks [] and standby tasks [] since 32154ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,961 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:29,971 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:30,024 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:30,061 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:30,062 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:30,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:30,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,069 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,069 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:30,100 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=67): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', members=[])
02.12.2021 17:25:30,101 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=47): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', members=[])
02.12.2021 17:25:30,101 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=67): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', members=[])
02.12.2021 17:25:30,101 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', members=[])
02.12.2021 17:25:30,101 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:30,101 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=58, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', protocol='stream'}
02.12.2021 17:25:30,101 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=58, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=58, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:30,101 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=68) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b,group_instance_id=null,assignments=[]}
02.12.2021 17:25:30,101 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', members=[])
02.12.2021 17:25:30,101 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', members=[])
02.12.2021 17:25:30,102 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:30,101 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 43
02.12.2021 17:25:30,101 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:30,102 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=58, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', protocol='stream'}
02.12.2021 17:25:30,102 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=58, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', protocol='stream'}
02.12.2021 17:25:30,102 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=58, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=58, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:30,102 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=58, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=58, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:30,102 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=48) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d,group_instance_id=null,assignments=[]}
02.12.2021 17:25:30,102 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=68) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21,group_instance_id=null,assignments=[]}
02.12.2021 17:25:30,102 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 22
02.12.2021 17:25:30,103 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 228
02.12.2021 17:25:30,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:30,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,125 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:30,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:30,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:30,125 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:30,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Committing all active tasks [] and standby tasks [] since 35148ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:30,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:30,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:30,126 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:30,140 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=68): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:30,140 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=48): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])
02.12.2021 17:25:30,141 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])
02.12.2021 17:25:30,141 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=58, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', protocol='stream'}
02.12.2021 17:25:30,141 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 58 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d
02.12.2021 17:25:30,141 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:30,141 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:30,141 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1474] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer] Requested to schedule immediate rebalance for new tasks to be safely revoked from current owner.
02.12.2021 17:25:30,141 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:30,141 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:30,142 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906] State transition from RUNNING to REBALANCING
02.12.2021 17:25:30,142 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:30,140 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=68): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:30,142 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:30,142 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=58, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', protocol='stream'}
02.12.2021 17:25:30,143 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 58 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21
02.12.2021 17:25:30,143 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:30,143 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:30,143 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:30,143 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:30,143 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:30,143 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:30,143 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 188
02.12.2021 17:25:30,140 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:30,143 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=58, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', protocol='stream'}
02.12.2021 17:25:30,142 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 485
02.12.2021 17:25:30,143 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 58 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b
02.12.2021 17:25:30,147 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:30,149 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:30,149 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:30,150 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:30,150 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:30,150 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:30,151 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 4
02.12.2021 17:25:30,151 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59191ms delay out of 60000ms. Remaining 809ms. Executor queue at 0
02.12.2021 17:25:30,152 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59398ms for 60000ms of delay, sleeping for 612ms
02.12.2021 17:25:30,155 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 511 ms and fetched 0 records
02.12.2021 17:25:30,155 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:30,155 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:30,155 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:30,155 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:30,155 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:30,156 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:30,156 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:30,156 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:30,156 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:30,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:30,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,156 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,156 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Committing all active tasks [] and standby tasks [] since 35188ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:30,157 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,157 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:30,161 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:30,162 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:30,169 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:30,211 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:30,211 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:30,211 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=75) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8,group_instance_id=null}
02.12.2021 17:25:30,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:30,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 87
02.12.2021 17:25:30,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 382
02.12.2021 17:25:30,257 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:30,262 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:30,263 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:30,269 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:30,312 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=75): org.apache.kafka.common.requests.HeartbeatResponse@360175fc
02.12.2021 17:25:30,312 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:30,322 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:30,322 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,322 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,322 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,322 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,322 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,322 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,322 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,322 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:30,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:30,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:30,332 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:30,332 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:30,332 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:30,332 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:30,332 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:30,332 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:30,332 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:30,332 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:30,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:30,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,334 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Committing all active tasks [] and standby tasks [] since 35269ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:30,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,335 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:30,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 281
02.12.2021 17:25:30,359 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:30,363 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:30,364 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:30,369 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:30,423 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:30,438 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 397
02.12.2021 17:25:30,445 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 181
02.12.2021 17:25:30,459 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:30,461 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:30,461 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,461 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:30,461 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,461 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,461 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,461 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,462 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,462 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:30,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,462 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:30,471 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:30,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:30,541 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 294
02.12.2021 17:25:30,546 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 80
02.12.2021 17:25:30,560 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:30,562 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:30,562 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:30,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:30,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,571 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,572 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:30,623 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:30,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:30,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:30,628 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Transiting to restore active tasks: {}
02.12.2021 17:25:30,628 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:30,629 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Paused partitions [] from the restore consumer
02.12.2021 17:25:30,631 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:30,632 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Transiting to update standby tasks: {}
02.12.2021 17:25:30,632 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:30,632 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Resumed partitions [] from the restore consumer
02.12.2021 17:25:30,632 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:30,633 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906] State transition from REBALANCING to RUNNING
02.12.2021 17:25:30,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Initialization call done. State is RUNNING
02.12.2021 17:25:30,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,633 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:30,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:30,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:30,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Committing all active tasks [] and standby tasks [] since 35656ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:30,633 INFO [org.apache.kafka.streams.processor.internals.StreamThread:555] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Triggering the followup rebalance scheduled for 0 ms.
02.12.2021 17:25:30,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:30,633 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 58 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d
02.12.2021 17:25:30,633 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:30,633 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:30,633 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 70, -39, -14, -119, 6, 48, 75, 25, -73, -14, -59, -98, 2, 41, -103, 6, 0, 0, 0, 0, 0, 0, 0, 0, 23, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:30,634 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=49) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:30,634 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:30,642 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 193
02.12.2021 17:25:30,646 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:30,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:30,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,657 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,658 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:30,663 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:30,663 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:30,675 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:30,724 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:30,743 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 93
02.12.2021 17:25:30,758 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:30,763 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:30,771 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59708ms for 60000ms of delay, sleeping for 302ms
02.12.2021 17:25:30,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 187
02.12.2021 17:25:30,776 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:30,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:30,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,824 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,824 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:30,842 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:30,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,845 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,845 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:30,860 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:30,867 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:30,876 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 86
02.12.2021 17:25:30,879 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:30,907 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119185ms delay out of 120000ms. Remaining 815ms. Executor queue at 1
02.12.2021 17:25:30,908 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119033ms for 120000ms of delay, sleeping for 977ms
02.12.2021 17:25:30,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:30,948 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 397
02.12.2021 17:25:30,961 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:30,962 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:30,962 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,962 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:30,962 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,962 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,963 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,963 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:30,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,963 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:30,979 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:31,026 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:31,048 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:31,061 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:31,063 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:31,064 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:31,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:31,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,072 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,073 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:31,076 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59307ms for 60000ms of delay, sleeping for 703ms
02.12.2021 17:25:31,127 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:31,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:31,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,134 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:31,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:31,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:31,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:31,135 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:31,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,159 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:31,164 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:31,164 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:31,173 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:31,227 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:31,249 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:31,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:31,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:31,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:31,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:31,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:31,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,325 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,325 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:31,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:31,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,346 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,346 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:31,359 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:31,364 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:31,365 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:31,374 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:31,425 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:31,446 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:31,460 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:31,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:31,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,463 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:31,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:31,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,464 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:31,474 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:31,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:31,547 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:31,561 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:31,565 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:31,564 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:31,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:31,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,576 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,579 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,579 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,579 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,579 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,579 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:31,628 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:31,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:31,637 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,637 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:31,637 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,638 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:31,638 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,638 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:31,638 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:31,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:31,648 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:31,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:31,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,664 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,665 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,665 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,665 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,666 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:31,667 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:31,667 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:31,683 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:31,730 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:31,748 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:31,767 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:31,768 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:31,767 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:31,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 10 records with 10 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:31,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 11 iterations.
02.12.2021 17:25:31,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 0 records with 11 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:31,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:31,781 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1140724, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:31,784 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1140734, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:31,784 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:31,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Main Consumer poll completed in 4 ms and fetched 10 records
02.12.2021 17:25:31,785 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-3, new queue size is 10
02.12.2021 17:25:31,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,785 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:31,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 11 iterations.
02.12.2021 17:25:31,788 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59654ms for 60000ms of delay, sleeping for 356ms
02.12.2021 17:25:31,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:31,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,828 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,835 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 428
02.12.2021 17:25:31,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:31,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,850 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,851 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:31,867 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:31,868 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:31,871 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 93
02.12.2021 17:25:31,884 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:31,892 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119679ms for 120000ms of delay, sleeping for 331ms
02.12.2021 17:25:31,939 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 324
02.12.2021 17:25:31,955 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 396
02.12.2021 17:25:31,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:31,965 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,965 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,965 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,965 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,965 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,965 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,965 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,965 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 434
02.12.2021 17:25:31,967 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:31,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:31,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,972 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,972 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 428
02.12.2021 17:25:31,984 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:32,039 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 224
02.12.2021 17:25:32,056 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 295
02.12.2021 17:25:32,065 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 334
02.12.2021 17:25:32,068 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:32,073 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 327
02.12.2021 17:25:32,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:32,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,083 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,083 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 110
02.12.2021 17:25:32,139 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:32,139 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,140 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 123
02.12.2021 17:25:32,140 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:32,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:32,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:32,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:32,140 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:32,146 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59187ms for 60000ms of delay, sleeping for 823ms
02.12.2021 17:25:32,156 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:32,166 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 233
02.12.2021 17:25:32,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:32,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,166 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,166 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:32,173 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 227
02.12.2021 17:25:32,183 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 10
02.12.2021 17:25:32,193 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:32,193 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:32,194 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=64) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42,group_instance_id=null}
02.12.2021 17:25:32,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,195 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=64): org.apache.kafka.common.requests.HeartbeatResponse@2fb980af
02.12.2021 17:25:32,195 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:32,196 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 388
02.12.2021 17:25:32,198 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 385
02.12.2021 17:25:32,230 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119880ms for 120000ms of delay, sleeping for 130ms
02.12.2021 17:25:32,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 23
02.12.2021 17:25:32,257 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 94
02.12.2021 17:25:32,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,265 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:32,265 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:32,265 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=64) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422,group_instance_id=null}
02.12.2021 17:25:32,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 70
02.12.2021 17:25:32,265 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=64): org.apache.kafka.common.requests.HeartbeatResponse@27bd24dd
02.12.2021 17:25:32,266 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:32,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 69
02.12.2021 17:25:32,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 69
02.12.2021 17:25:32,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 133
02.12.2021 17:25:32,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:32,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 127
02.12.2021 17:25:32,300 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 283
02.12.2021 17:25:32,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:32,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,335 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,335 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:32,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:32,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,351 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,351 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,352 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:32,367 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 32
02.12.2021 17:25:32,367 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:32,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 10 records with 31 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:32,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 93892ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:32,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:32,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 32 iterations.
02.12.2021 17:25:32,374 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 27
02.12.2021 17:25:32,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 0 records with 32 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:32,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 93897ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:32,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:32,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:32,379 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=60): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', members=[])
02.12.2021 17:25:32,379 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', members=[])
02.12.2021 17:25:32,380 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:32,380 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=189, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', protocol='stream'}
02.12.2021 17:25:32,380 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=189, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=189, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:32,380 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1001753, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:32,380 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1001763, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:32,380 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=61) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336,group_instance_id=null,assignments=[]}
02.12.2021 17:25:32,380 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Main Consumer poll completed in 3 ms and fetched 10 records
02.12.2021 17:25:32,381 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] task [0_8] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-8, new queue size is 10
02.12.2021 17:25:32,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,381 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:32,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 32 iterations.
02.12.2021 17:25:32,382 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=61): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:32,382 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=189, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', protocol='stream'}
02.12.2021 17:25:32,384 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119987ms for 120000ms of delay, sleeping for 23ms
02.12.2021 17:25:32,399 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:32,399 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 189 and member id staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:32,399 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=66) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf,group_instance_id=null}
02.12.2021 17:25:32,399 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,400 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=66): org.apache.kafka.common.requests.HeartbeatResponse@4832fa1f
02.12.2021 17:25:32,400 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:32,400 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 189 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf
02.12.2021 17:25:32,400 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:32,400 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:32,401 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 123, -60, 27, -87, -99, 46, 69, 70, -123, -109, 86, 85, 111, -45, 14, -12, 0, 0, 0, 0, 0, 0, 0, 0, 22, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:32,401 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=67) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:32,401 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 64
02.12.2021 17:25:32,401 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 182
02.12.2021 17:25:32,403 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,403 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,403 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,403 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,403 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,403 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,403 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,404 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,404 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,404 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,404 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,404 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,404 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,404 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,404 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,404 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:32,405 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 189 and member id staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:32,405 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=66) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82,group_instance_id=null}
02.12.2021 17:25:32,406 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 68
02.12.2021 17:25:32,406 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=66): org.apache.kafka.common.requests.HeartbeatResponse@31075f8f
02.12.2021 17:25:32,406 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:32,406 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 189 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82
02.12.2021 17:25:32,406 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:32,406 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:32,407 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 123, -60, 27, -87, -99, 46, 69, 70, -123, -109, 86, 85, 111, -45, 14, -12, 0, 0, 0, 0, 0, 0, 0, 0, 22, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:32,407 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=67) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:32,407 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 65
02.12.2021 17:25:32,410 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119196ms for 120000ms of delay, sleeping for 814ms
02.12.2021 17:25:32,436 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:32,452 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:32,465 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:32,465 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,465 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,466 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:32,470 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:32,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:32,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,472 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,473 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:32,500 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:32,502 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 81
02.12.2021 17:25:32,506 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:32,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:32,552 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:32,571 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:32,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:32,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,583 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,584 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,584 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:32,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:32,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:32,642 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,642 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:32,642 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,642 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:32,642 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,642 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:32,642 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:32,642 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:32,653 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:32,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:32,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,666 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,666 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 435
02.12.2021 17:25:32,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:32,754 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:32,741 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:32,767 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 334
02.12.2021 17:25:32,790 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:32,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 518 ms and fetched 0 records
02.12.2021 17:25:32,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,853 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:32,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,853 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,853 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 249
02.12.2021 17:25:32,854 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:32,869 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 232
02.12.2021 17:25:32,891 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:32,954 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 148
02.12.2021 17:25:32,954 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:32,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:32,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,967 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,967 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:32,969 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 132
02.12.2021 17:25:32,971 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59853ms for 60000ms of delay, sleeping for 157ms
02.12.2021 17:25:32,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:32,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,974 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,974 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:32,991 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:33,054 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:33,054 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 48
02.12.2021 17:25:33,070 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 31
02.12.2021 17:25:33,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,085 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,085 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:33,101 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,101 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,101 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,101 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,101 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,101 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,102 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,102 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,102 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,102 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:33,102 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 58 and member id staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:33,102 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=69) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b,group_instance_id=null}
02.12.2021 17:25:33,102 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 64
02.12.2021 17:25:33,102 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=69): org.apache.kafka.common.requests.HeartbeatResponse@7ab01f70
02.12.2021 17:25:33,102 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:33,102 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 58 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b
02.12.2021 17:25:33,103 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:33,103 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:33,103 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,103 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,103 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,103 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,103 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 70, -39, -14, -119, 6, 48, 75, 25, -73, -14, -59, -98, 2, 41, -103, 6, 0, 0, 0, 0, 0, 0, 0, 0, 23, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:33,103 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=70) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:33,103 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 63
02.12.2021 17:25:33,104 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:33,104 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 58 and member id staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:33,104 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=69) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21,group_instance_id=null}
02.12.2021 17:25:33,104 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 250
02.12.2021 17:25:33,104 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=69): org.apache.kafka.common.requests.HeartbeatResponse@7298cf49
02.12.2021 17:25:33,104 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:33,105 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 58 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21
02.12.2021 17:25:33,105 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:33,105 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:33,105 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 70, -39, -14, -119, 6, 48, 75, 25, -73, -14, -59, -98, 2, 41, -103, 6, 0, 0, 0, 0, 0, 0, 0, 0, 23, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:33,105 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=70) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:33,105 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 248
02.12.2021 17:25:33,132 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59980ms for 60000ms of delay, sleeping for 30ms
02.12.2021 17:25:33,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:33,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,142 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:33,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,142 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:33,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:33,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:33,143 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:33,155 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:33,164 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59727ms for 60000ms of delay, sleeping for 283ms
02.12.2021 17:25:33,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,167 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,167 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:33,185 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:33,202 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:33,204 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:33,223 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:33,223 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:33,224 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=76) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8,group_instance_id=null}
02.12.2021 17:25:33,226 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119823ms for 120000ms of delay, sleeping for 187ms
02.12.2021 17:25:33,255 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:33,286 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:33,324 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=76): org.apache.kafka.common.requests.HeartbeatResponse@6ec672ac
02.12.2021 17:25:33,324 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:33,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:33,354 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,354 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,354 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,354 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,354 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,354 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,354 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,354 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:33,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,355 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,355 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:33,387 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:33,414 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119869ms for 120000ms of delay, sleeping for 141ms
02.12.2021 17:25:33,450 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59331ms for 60000ms of delay, sleeping for 679ms
02.12.2021 17:25:33,456 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:33,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,470 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,470 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,470 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,477 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,478 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:33,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,478 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:33,488 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:33,556 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119250ms for 120000ms of delay, sleeping for 760ms
02.12.2021 17:25:33,557 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:33,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:33,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,585 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:33,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:33,646 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,646 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:33,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:33,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:33,651 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:33,651 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:33,658 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:33,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,668 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,670 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:33,688 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:33,759 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:33,793 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:33,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:33,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,855 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,855 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:33,856 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:33,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,857 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,858 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:33,893 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:33,959 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:33,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:33,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,978 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,978 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:33,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:33,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,979 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,979 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:33,994 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:34,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:34,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:34,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,088 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,088 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:34,132 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59143ms for 60000ms of delay, sleeping for 867ms
02.12.2021 17:25:34,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:34,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,151 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:34,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:34,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:34,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:34,152 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:34,159 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:34,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:34,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,172 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,173 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,173 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:34,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:34,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:34,289 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:34,318 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119362ms for 120000ms of delay, sleeping for 648ms
02.12.2021 17:25:34,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,356 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,358 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,358 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:34,358 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:34,389 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:34,459 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:34,479 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,479 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,479 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,479 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,479 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,480 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,480 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:34,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,481 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:34,489 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:34,559 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:34,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,589 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,589 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:34,652 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:34,652 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,653 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:34,655 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,655 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:34,655 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,655 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:34,655 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:34,657 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:34,659 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:34,673 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:34,673 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,673 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,673 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,673 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,673 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,673 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,673 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,674 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:34,689 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:34,760 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:34,790 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:34,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:34,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,860 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,861 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 404
02.12.2021 17:25:34,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:34,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,861 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,862 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:34,892 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:34,962 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 303
02.12.2021 17:25:34,967 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119910ms for 120000ms of delay, sleeping for 100ms
02.12.2021 17:25:34,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,981 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,981 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,982 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:34,982 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:34,992 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:35,000 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59928ms for 60000ms of delay, sleeping for 82ms
02.12.2021 17:25:35,062 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 203
02.12.2021 17:25:35,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 10 records with 32 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:35,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 96590ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:35,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:35,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 33 iterations.
02.12.2021 17:25:35,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 0 records with 33 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:35,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 96590ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:35,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:35,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:35,069 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:35,069 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:35,069 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:35,070 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 123, -60, 27, -87, -99, 46, 69, 70, -123, -109, 86, 85, 111, -45, 14, -12, 0, 0, 0, 0, 0, 0, 0, 0, 22, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 8])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:35,070 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=62) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:35,070 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1001763, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:35,070 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1001773, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:35,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:35,071 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] task [0_8] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-8, new queue size is 10
02.12.2021 17:25:35,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,071 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:35,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 33 iterations.
02.12.2021 17:25:35,072 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119008ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:35,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 10 records with 11 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:35,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 12 iterations.
02.12.2021 17:25:35,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 0 records with 12 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:35,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:35,084 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1140734, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:35,084 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1140744, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:35,084 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:35,084 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-3, new queue size is 10
02.12.2021 17:25:35,084 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,084 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:35,084 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,084 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 12 iterations.
02.12.2021 17:25:35,085 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58952ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:35,088 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:35,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:35,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,089 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,090 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 103
02.12.2021 17:25:35,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:35,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,159 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:35,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:35,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:35,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:35,159 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:35,163 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 102
02.12.2021 17:25:35,173 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:35,173 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,173 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,173 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,173 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,173 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,173 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,173 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,173 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:35,190 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 3
02.12.2021 17:25:35,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,195 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:35,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,195 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:35,196 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=65) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42,group_instance_id=null}
02.12.2021 17:25:35,196 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 395
02.12.2021 17:25:35,196 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=65): org.apache.kafka.common.requests.HeartbeatResponse@71a625c
02.12.2021 17:25:35,197 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:35,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 393
02.12.2021 17:25:35,198 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 392
02.12.2021 17:25:35,263 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 2
02.12.2021 17:25:35,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,266 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:35,266 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:35,266 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=65) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422,group_instance_id=null}
02.12.2021 17:25:35,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:35,266 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=65): org.apache.kafka.common.requests.HeartbeatResponse@567a3920
02.12.2021 17:25:35,266 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:35,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:35,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:35,299 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 291
02.12.2021 17:25:35,361 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,361 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,361 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,361 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,361 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,361 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,361 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,361 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,361 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:35,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,363 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,363 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:35,399 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:35,461 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:35,482 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:35,483 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,483 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,483 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,483 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,483 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,483 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,483 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:35,483 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,483 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,483 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,483 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,484 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:35,483 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,484 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,484 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,484 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,484 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:35,499 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:35,563 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:35,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,591 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:35,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,661 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:35,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:35,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:35,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:35,664 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:35,662 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:35,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,674 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,674 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:35,693 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:35,764 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:35,793 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:35,801 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=67): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', members=[])
02.12.2021 17:25:35,801 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', members=[])
02.12.2021 17:25:35,801 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:35,801 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=190, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', protocol='stream'}
02.12.2021 17:25:35,802 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=190, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=190, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:35,802 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=68) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82,group_instance_id=null,assignments=[]}
02.12.2021 17:25:35,802 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 182
02.12.2021 17:25:35,801 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=67): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', members=[])
02.12.2021 17:25:35,805 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', members=[])
02.12.2021 17:25:35,807 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:35,807 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=190, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', protocol='stream'}
02.12.2021 17:25:35,808 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=190, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=190, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:35,810 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=68) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf,group_instance_id=null,assignments=[]}
02.12.2021 17:25:35,810 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 173
02.12.2021 17:25:35,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:35,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,862 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,863 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:35,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,864 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,865 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:35,894 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:35,903 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=68): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:35,903 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:35,904 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=190, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', protocol='stream'}
02.12.2021 17:25:35,904 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 190 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf
02.12.2021 17:25:35,904 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:35,904 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:35,904 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:35,904 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:35,904 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:35,904 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4] State transition from RUNNING to REBALANCING
02.12.2021 17:25:35,904 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:35,904 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 80
02.12.2021 17:25:35,904 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=68): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:35,906 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:35,907 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=190, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', protocol='stream'}
02.12.2021 17:25:35,907 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 190 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82
02.12.2021 17:25:35,909 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:35,909 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:35,909 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:35,909 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:35,909 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:35,909 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:35,909 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 78
02.12.2021 17:25:35,963 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:35,985 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:35,985 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:35,985 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:35,985 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:35,986 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:35,986 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:35,986 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:35,986 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:35,986 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:35,986 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:35,986 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:35,987 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,987 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,987 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,987 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,987 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,987 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,987 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,987 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:35,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:35,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:35,988 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:35,988 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:35,988 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:35,988 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:35,988 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:35,988 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:35,988 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:35,988 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:35,988 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4] State transition from REBALANCING to RUNNING
02.12.2021 17:25:35,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:35,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,988 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,988 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:35,994 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:36,064 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:36,074 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119937ms for 120000ms of delay, sleeping for 73ms
02.12.2021 17:25:36,085 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59952ms delay out of 60000ms. Remaining 48ms. Executor queue at 0
02.12.2021 17:25:36,086 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59842ms for 60000ms of delay, sleeping for 168ms
02.12.2021 17:25:36,088 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:36,089 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:36,092 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,092 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,092 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,092 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,092 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,092 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,092 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,092 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,092 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:36,148 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119983ms for 120000ms of delay, sleeping for 27ms
02.12.2021 17:25:36,164 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:36,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:36,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,168 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:36,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:36,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:36,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:36,169 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:36,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,175 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,176 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:36,176 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119956ms for 120000ms of delay, sleeping for 54ms
02.12.2021 17:25:36,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:36,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:36,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:36,229 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:36,229 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:36,229 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=77) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8,group_instance_id=null}
02.12.2021 17:25:36,232 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119594ms for 120000ms of delay, sleeping for 416ms
02.12.2021 17:25:36,256 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59855ms for 60000ms of delay, sleeping for 155ms
02.12.2021 17:25:36,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:36,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:36,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:36,298 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:36,330 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=77): org.apache.kafka.common.requests.HeartbeatResponse@6233def6
02.12.2021 17:25:36,330 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:36,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,367 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,367 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:36,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:36,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,367 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,368 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:36,392 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:36,392 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:36,402 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:36,414 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59972ms for 60000ms of delay, sleeping for 38ms
02.12.2021 17:25:36,455 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59677ms for 60000ms of delay, sleeping for 333ms
02.12.2021 17:25:36,467 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:36,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:36,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,489 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,490 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:36,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:36,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,490 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,490 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:36,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 88
02.12.2021 17:25:36,568 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:36,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:36,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:36,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:36,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,592 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:36,651 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119486ms for 120000ms of delay, sleeping for 524ms
02.12.2021 17:25:36,668 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:36,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:36,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,670 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:36,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:36,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:36,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:36,670 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:36,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,676 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,676 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:36,690 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:36,693 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:36,691 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:36,768 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:36,792 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:36,793 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:36,795 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59735ms for 60000ms of delay, sleeping for 275ms
02.12.2021 17:25:36,798 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 192
02.12.2021 17:25:36,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,868 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,868 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:36,870 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:36,870 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,870 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,871 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:36,893 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:36,893 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:36,898 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 92
02.12.2021 17:25:36,968 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:36,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:36,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,990 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,991 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:36,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,991 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,991 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:36,993 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:37,069 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:37,072 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59996ms for 60000ms of delay, sleeping for 14ms
02.12.2021 17:25:37,088 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59794ms for 60000ms of delay, sleeping for 216ms
02.12.2021 17:25:37,091 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:37,091 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:37,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:37,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,093 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,093 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:37,169 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:37,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:37,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,170 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:37,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:37,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:37,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:37,171 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:37,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:37,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,177 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,178 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,178 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:37,182 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118622ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:37,192 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:37,191 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:37,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:37,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:37,293 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:37,293 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:37,294 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:37,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 10 records with 12 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:37,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 13 iterations.
02.12.2021 17:25:37,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 0 records with 13 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:37,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:37,305 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 9 fetched records at offset FetchPosition{offset=1140744, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:37,305 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1140753, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:37,305 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:1199] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Added READ_UNCOMMITTED fetch request for partition redacted.Cloud.Message.Callback.Retry1-3 at position FetchPosition{offset=1140753, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.par.eu.dc.sigfox.com:9093 (id: 4 rack: null)], epoch=absent}} to node kafka-5.data.sta.par.eu.dc.sigfox.com:9093 (id: 4 rack: null)
02.12.2021 17:25:37,306 DEBUG [org.apache.kafka.clients.FetchSessionHandler:259] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Built incremental fetch (sessionId=1206255669, epoch=3) for node 4. Added (), altered (redacted.Cloud.Message.Callback.Retry1-3), removed () out of (OSS.STAGING.Cloud.Message.Callback.Retry1-3)
02.12.2021 17:25:37,306 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:266] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(redacted.Cloud.Message.Callback.Retry1-3), toForget=(), implied=()) to broker kafka-5.data.sta.par.eu.dc.sigfox.com:9093 (id: 4 rack: null)
02.12.2021 17:25:37,306 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending FETCH request with header RequestHeader(apiKey=FETCH, apiVersion=11, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=78) and timeout 30000 to node 4: {replica_id=-1,max_wait_ms=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=1206255669,session_epoch=3,topics=[{topic=redacted.Cloud.Message.Callback.Retry1,partitions=[{partition=3,current_leader_epoch=-1,fetch_offset=1140753,log_start_offset=-1,partition_max_bytes=1048576}]}],forgotten_topics_data=[],rack_id=}
02.12.2021 17:25:37,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 9 records
02.12.2021 17:25:37,306 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-3, new queue size is 9
02.12.2021 17:25:37,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,306 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:37,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 13 iterations.
02.12.2021 17:25:37,307 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59533ms for 60000ms of delay, sleeping for 477ms
02.12.2021 17:25:37,332 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received FETCH response from node 4 for request with header RequestHeader(apiKey=FETCH, apiVersion=11, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=78): org.apache.kafka.common.requests.FetchResponse@c3f7cf
02.12.2021 17:25:37,332 DEBUG [org.apache.kafka.clients.FetchSessionHandler:463] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Node 4 sent an incremental fetch response with throttleTimeMs = 0 for session 1206255669 with response=(redacted.Cloud.Message.Callback.Retry1-3)
02.12.2021 17:25:37,332 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:315] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Fetch READ_UNCOMMITTED at offset 1140753 for partition redacted.Cloud.Message.Callback.Retry1-3 returned fetch data (error=NONE, highWaterMark=1140917, lastStableOffset = 1140917, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, divergingEpoch =Optional.empty, recordsSizeInBytes=74623)
02.12.2021 17:25:37,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:37,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:37,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,372 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,373 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,373 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:37,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,375 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:37,393 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:37,393 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:37,394 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:37,463 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=49): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', members=[])
02.12.2021 17:25:37,463 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=70): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', members=[])
02.12.2021 17:25:37,463 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', members=[])
02.12.2021 17:25:37,463 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:37,463 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', members=[])
02.12.2021 17:25:37,463 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=70): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', members=[])
02.12.2021 17:25:37,463 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', members=[])
02.12.2021 17:25:37,464 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:37,463 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:37,463 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=59, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', protocol='stream'}
02.12.2021 17:25:37,464 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=59, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=59, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:37,464 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=59, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', protocol='stream'}
02.12.2021 17:25:37,464 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=71) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b,group_instance_id=null,assignments=[]}
02.12.2021 17:25:37,464 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=59, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', protocol='stream'}
02.12.2021 17:25:37,464 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=59, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=59, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:37,464 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=59, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=59, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:37,465 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=71) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21,group_instance_id=null,assignments=[]}
02.12.2021 17:25:37,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 214
02.12.2021 17:25:37,465 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=50) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d,group_instance_id=null,assignments=[]}
02.12.2021 17:25:37,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 408
02.12.2021 17:25:37,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 206
02.12.2021 17:25:37,476 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:37,492 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:37,492 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,492 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,492 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,492 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,492 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,492 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:37,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,493 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,493 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:37,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,494 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:37,495 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:37,576 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:37,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:37,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:37,594 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,594 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,594 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,594 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,594 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,594 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,594 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:37,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:37,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:37,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,678 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:37,672 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:37,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:37,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:37,680 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,680 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:37,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:37,688 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:37,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,688 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:37,694 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:37,696 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:37,696 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:37,779 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:37,794 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:37,794 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59778ms for 60000ms of delay, sleeping for 232ms
02.12.2021 17:25:37,797 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:37,797 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:37,874 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:37,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,876 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,876 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:37,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:37,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,878 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,878 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 388
02.12.2021 17:25:37,898 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:37,898 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:37,895 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:37,982 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 284
02.12.2021 17:25:37,998 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:37,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:37,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,999 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,999 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:38,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:38,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,002 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,012 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:38,032 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58995ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:38,083 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 183
02.12.2021 17:25:38,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:38,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,096 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,097 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:38,100 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:38,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 398
02.12.2021 17:25:38,183 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 83
02.12.2021 17:25:38,183 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119623ms delay out of 120000ms. Remaining 377ms. Executor queue at 0
02.12.2021 17:25:38,184 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119603ms for 120000ms of delay, sleeping for 407ms
02.12.2021 17:25:38,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:38,195 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:38,195 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:38,195 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=66) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42,group_instance_id=null}
02.12.2021 17:25:38,195 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 402
02.12.2021 17:25:38,196 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=66): org.apache.kafka.common.requests.HeartbeatResponse@519397ea
02.12.2021 17:25:38,196 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:38,196 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 401
02.12.2021 17:25:38,196 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 401
02.12.2021 17:25:38,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,204 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:38,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,200 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:38,206 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:38,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,211 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:38,212 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,212 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:38,212 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:38,215 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:38,214 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:38,217 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:38,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,273 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:38,274 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:38,277 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=66) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422,group_instance_id=null}
02.12.2021 17:25:38,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 105
02.12.2021 17:25:38,277 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=66): org.apache.kafka.common.requests.HeartbeatResponse@63abe069
02.12.2021 17:25:38,278 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:38,278 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 100
02.12.2021 17:25:38,278 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 100
02.12.2021 17:25:38,296 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 301
02.12.2021 17:25:38,308 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 191
02.12.2021 17:25:38,316 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:38,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:38,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:38,380 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,381 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,381 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:38,378 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,381 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:38,396 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 201
02.12.2021 17:25:38,409 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 90
02.12.2021 17:25:38,416 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:38,481 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:38,497 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 100
02.12.2021 17:25:38,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:38,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,499 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,500 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 307
02.12.2021 17:25:38,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 511 ms and fetched 0 records
02.12.2021 17:25:38,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,513 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 287
02.12.2021 17:25:38,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:38,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:38,602 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 205
02.12.2021 17:25:38,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,603 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,603 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:38,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 10 records with 33 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:38,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 100127ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:38,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:38,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 34 iterations.
02.12.2021 17:25:38,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 0 records with 34 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:38,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 100127ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:38,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:38,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:38,606 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=62): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', members=[])
02.12.2021 17:25:38,608 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', members=[])
02.12.2021 17:25:38,609 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:38,610 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=190, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', protocol='stream'}
02.12.2021 17:25:38,611 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=190, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=190, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:38,611 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1001773, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:38,611 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1001783, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:38,612 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=63) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336,group_instance_id=null,assignments=[]}
02.12.2021 17:25:38,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Main Consumer poll completed in 6 ms and fetched 10 records
02.12.2021 17:25:38,615 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] task [0_8] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-8, new queue size is 10
02.12.2021 17:25:38,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,615 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:38,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 34 iterations.
02.12.2021 17:25:38,615 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 186
02.12.2021 17:25:38,616 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119562ms for 120000ms of delay, sleeping for 448ms
02.12.2021 17:25:38,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:38,703 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:38,703 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 104
02.12.2021 17:25:38,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:38,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,711 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,712 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=63): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:38,713 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=190, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', protocol='stream'}
02.12.2021 17:25:38,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,719 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:38,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:38,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,720 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:38,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:38,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:38,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:38,720 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:38,716 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 85
02.12.2021 17:25:38,803 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:38,791 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:38,807 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:38,807 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 190 and member id staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:38,808 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=69) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82,group_instance_id=null}
02.12.2021 17:25:38,806 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:38,808 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=69): org.apache.kafka.common.requests.HeartbeatResponse@252679fb
02.12.2021 17:25:38,819 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:38,819 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 190 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82
02.12.2021 17:25:38,819 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:38,811 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:38,822 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 190 and member id staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:38,823 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=69) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf,group_instance_id=null}
02.12.2021 17:25:38,821 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:38,823 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 189
02.12.2021 17:25:38,824 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=69): org.apache.kafka.common.requests.HeartbeatResponse@21826b3e
02.12.2021 17:25:38,824 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 123, -60, 27, -87, -99, 46, 69, 70, -123, -109, 86, 85, 111, -45, 14, -12, 0, 0, 0, 0, 0, 0, 0, 0, 23, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:38,825 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=70) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:38,825 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:38,826 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 188
02.12.2021 17:25:38,826 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 190 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf
02.12.2021 17:25:38,830 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:38,831 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:38,831 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 123, -60, 27, -87, -99, 46, 69, 70, -123, -109, 86, 85, 111, -45, 14, -12, 0, 0, 0, 0, 0, 0, 0, 0, 23, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:38,832 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=70) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:38,833 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 167
02.12.2021 17:25:38,882 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:38,882 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,882 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,882 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,882 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,882 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,882 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,882 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,882 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:38,897 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 516 ms and fetched 0 records
02.12.2021 17:25:38,897 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,897 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,897 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,897 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,897 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,897 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,897 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,897 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:38,904 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:38,919 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:38,923 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:38,998 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:39,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,001 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,001 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:39,004 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:39,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:39,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,017 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,017 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:39,032 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59995ms delay out of 60000ms. Remaining 5ms. Executor queue at 0
02.12.2021 17:25:39,033 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59263ms for 60000ms of delay, sleeping for 747ms
02.12.2021 17:25:39,070 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119265ms for 120000ms of delay, sleeping for 745ms
02.12.2021 17:25:39,098 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:39,103 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:39,103 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,103 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,104 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:39,198 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:39,204 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:39,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:39,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,220 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,221 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,222 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:39,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:39,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:39,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,222 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:39,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:39,224 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:39,236 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:39,236 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:39,236 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=79) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8,group_instance_id=null}
02.12.2021 17:25:39,301 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:39,307 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:39,337 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=79): org.apache.kafka.common.requests.HeartbeatResponse@3d50dcbe
02.12.2021 17:25:39,337 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:39,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,383 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,384 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:39,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:39,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,397 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,397 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:39,407 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:39,498 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:39,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,502 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,502 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,502 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:39,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:39,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,518 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:39,599 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:39,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:39,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,604 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,605 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:39,699 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:39,705 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:39,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:39,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,725 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,725 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:39,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:39,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,729 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:39,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:39,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:39,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:39,743 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:39,791 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59845ms for 60000ms of delay, sleeping for 165ms
02.12.2021 17:25:39,806 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:39,806 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:39,822 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119722ms for 120000ms of delay, sleeping for 288ms
02.12.2021 17:25:39,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,885 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,886 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:39,897 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:39,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,902 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,902 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:39,907 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:39,958 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59512ms for 60000ms of delay, sleeping for 498ms
02.12.2021 17:25:40,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,019 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,019 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:40,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 521 ms and fetched 0 records
02.12.2021 17:25:40,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,023 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,024 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 82
02.12.2021 17:25:40,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,026 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:40,002 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:40,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,106 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,106 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:40,114 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119921ms for 120000ms of delay, sleeping for 89ms
02.12.2021 17:25:40,131 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 271
02.12.2021 17:25:40,206 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119368ms for 120000ms of delay, sleeping for 642ms
02.12.2021 17:25:40,207 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:40,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,226 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 237
02.12.2021 17:25:40,231 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 171
02.12.2021 17:25:40,243 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:40,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,244 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:40,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:40,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:40,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:40,246 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 218
02.12.2021 17:25:40,307 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:40,333 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 69
02.12.2021 17:25:40,386 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:40,387 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,387 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,389 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 75
02.12.2021 17:25:40,402 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:40,402 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,402 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,402 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,402 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,402 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,403 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,403 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,403 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:40,408 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:40,458 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59707ms for 60000ms of delay, sleeping for 303ms
02.12.2021 17:25:40,463 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:40,463 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:40,464 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=72) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b,group_instance_id=null}
02.12.2021 17:25:40,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 262
02.12.2021 17:25:40,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:40,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:40,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:40,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:40,464 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:40,465 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:40,465 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:40,465 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=51) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d,group_instance_id=null}
02.12.2021 17:25:40,465 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:40,465 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=72) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21,group_instance_id=null}
02.12.2021 17:25:40,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 281
02.12.2021 17:25:40,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 424
02.12.2021 17:25:40,505 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:40,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:40,521 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:40,521 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,521 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,521 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,521 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,521 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,521 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,521 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:40,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:40,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,527 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:40,605 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:40,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:40,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,606 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,607 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,607 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:40,707 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:40,707 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:40,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:40,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,730 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,732 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:40,747 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:40,750 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,750 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:40,750 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,750 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:40,750 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,750 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:40,750 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:40,750 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:40,763 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59981ms for 60000ms of delay, sleeping for 29ms
02.12.2021 17:25:40,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 9 records with 13 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:40,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 14 iterations.
02.12.2021 17:25:40,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 0 records with 14 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:40,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:40,801 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1251] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Preparing to read 74623 bytes of data for partition redacted.Cloud.Message.Callback.Retry1-3 with offset FetchPosition{offset=1140753, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.par.eu.dc.sigfox.com:9093 (id: 4 rack: null)], epoch=absent}}
02.12.2021 17:25:40,806 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1275] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Updating high watermark for partition redacted.Cloud.Message.Callback.Retry1-3 to 1140917
02.12.2021 17:25:40,806 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1280] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Updating log start offset for partition redacted.Cloud.Message.Callback.Retry1-3 to 0
02.12.2021 17:25:40,806 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1285] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Updating last stable offset for partition redacted.Cloud.Message.Callback.Retry1-3 to 1140917
02.12.2021 17:25:40,806 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1140753, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:40,807 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1140763, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:40,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Main Consumer poll completed in 8 ms and fetched 10 records
02.12.2021 17:25:40,808 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-3, new queue size is 10
02.12.2021 17:25:40,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,808 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:40,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 14 iterations.
02.12.2021 17:25:40,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:40,811 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:40,814 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59940ms for 60000ms of delay, sleeping for 70ms
02.12.2021 17:25:40,849 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119970ms for 120000ms of delay, sleeping for 40ms
02.12.2021 17:25:40,886 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58937ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:40,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,891 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,892 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119922ms for 120000ms of delay, sleeping for 88ms
02.12.2021 17:25:40,892 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:40,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:40,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,906 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,907 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 366
02.12.2021 17:25:40,911 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:40,982 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119816ms for 120000ms of delay, sleeping for 194ms
02.12.2021 17:25:41,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 266
02.12.2021 17:25:41,012 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:41,022 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,022 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,022 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,022 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,022 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,022 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,022 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,022 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,022 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:41,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,028 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,028 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:41,107 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 166
02.12.2021 17:25:41,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:41,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,107 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,108 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,108 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,108 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,108 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,108 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 87
02.12.2021 17:25:41,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 10 records with 34 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:41,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 102704ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:41,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:41,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 35 iterations.
02.12.2021 17:25:41,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 0 records with 35 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:41,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 102705ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:41,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:41,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:41,186 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:41,188 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:41,188 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:41,189 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 123, -60, 27, -87, -99, 46, 69, 70, -123, -109, 86, 85, 111, -45, 14, -12, 0, 0, 0, 0, 0, 0, 0, 0, 23, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 8])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:41,190 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=64) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:41,191 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1001783, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:41,191 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1001793, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:41,191 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=70): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', members=[])
02.12.2021 17:25:41,191 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', members=[])
02.12.2021 17:25:41,192 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:41,191 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=70): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', members=[])
02.12.2021 17:25:41,191 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Main Consumer poll completed in 6 ms and fetched 10 records
02.12.2021 17:25:41,193 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] task [0_8] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-8, new queue size is 10
02.12.2021 17:25:41,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,193 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:41,192 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', members=[])
02.12.2021 17:25:41,193 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:41,192 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=191, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', protocol='stream'}
02.12.2021 17:25:41,193 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=191, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=191, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:41,193 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=191, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', protocol='stream'}
02.12.2021 17:25:41,194 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=71) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf,group_instance_id=null,assignments=[]}
02.12.2021 17:25:41,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 35 iterations.
02.12.2021 17:25:41,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 334
02.12.2021 17:25:41,194 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=191, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=191, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:41,195 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=71) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82,group_instance_id=null,assignments=[]}
02.12.2021 17:25:41,196 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 327
02.12.2021 17:25:41,195 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:41,196 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:41,197 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119922ms for 120000ms of delay, sleeping for 88ms
02.12.2021 17:25:41,196 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=67) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42,group_instance_id=null}
02.12.2021 17:25:41,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 413
02.12.2021 17:25:41,198 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=67): org.apache.kafka.common.requests.HeartbeatResponse@3b05f9cf
02.12.2021 17:25:41,198 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:41,198 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 410
02.12.2021 17:25:41,199 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 409
02.12.2021 17:25:41,208 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 65
02.12.2021 17:25:41,216 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:41,221 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=71): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,221 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,221 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=71): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,221 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=191, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', protocol='stream'}
02.12.2021 17:25:41,223 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 191 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf
02.12.2021 17:25:41,223 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:41,223 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:41,223 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,223 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=191, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', protocol='stream'}
02.12.2021 17:25:41,224 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 191 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82
02.12.2021 17:25:41,224 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:41,224 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:41,224 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:41,224 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:41,224 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:41,224 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4] State transition from RUNNING to REBALANCING
02.12.2021 17:25:41,224 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:41,224 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:41,223 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:41,224 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:41,225 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:41,227 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:41,227 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 307
02.12.2021 17:25:41,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:41,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,236 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,236 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:41,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:41,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,252 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:41,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:41,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:41,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:41,253 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:41,273 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:41,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,274 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:41,275 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=67) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422,group_instance_id=null}
02.12.2021 17:25:41,275 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 133
02.12.2021 17:25:41,275 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=67): org.apache.kafka.common.requests.HeartbeatResponse@65179eb6
02.12.2021 17:25:41,275 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:41,276 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 132
02.12.2021 17:25:41,276 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 131
02.12.2021 17:25:41,286 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119639ms for 120000ms of delay, sleeping for 371ms
02.12.2021 17:25:41,300 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 308
02.12.2021 17:25:41,325 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:41,328 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 200
02.12.2021 17:25:41,376 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 31
02.12.2021 17:25:41,393 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,393 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,393 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,393 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,393 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,393 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,393 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,393 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,393 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:41,400 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 208
02.12.2021 17:25:41,408 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,408 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,408 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,408 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,408 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,408 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,408 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,409 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:41,425 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:41,428 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 100
02.12.2021 17:25:41,490 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=50): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])
02.12.2021 17:25:41,490 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=71): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,490 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=71): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,490 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0])
02.12.2021 17:25:41,491 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,490 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,491 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=59, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', protocol='stream'}
02.12.2021 17:25:41,491 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=59, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', protocol='stream'}
02.12.2021 17:25:41,491 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=59, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', protocol='stream'}
02.12.2021 17:25:41,491 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=72): org.apache.kafka.common.requests.HeartbeatResponse@21dbb081
02.12.2021 17:25:41,491 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=51): org.apache.kafka.common.requests.HeartbeatResponse@7cd9f924
02.12.2021 17:25:41,491 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:41,491 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 59 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d
02.12.2021 17:25:41,491 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=72): org.apache.kafka.common.requests.HeartbeatResponse@790bd9e6
02.12.2021 17:25:41,492 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:41,492 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:41,491 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:41,492 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1474] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer] Requested to schedule immediate rebalance for new tasks to be safely revoked from current owner.
02.12.2021 17:25:41,492 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:41,492 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:41,492 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:41,492 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 59 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21
02.12.2021 17:25:41,492 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906] State transition from RUNNING to REBALANCING
02.12.2021 17:25:41,493 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:41,492 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 59 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b
02.12.2021 17:25:41,493 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 263
02.12.2021 17:25:41,493 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:41,493 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:41,493 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 260
02.12.2021 17:25:41,493 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:41,493 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:41,493 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:41,493 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:41,493 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:41,493 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:41,494 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:41,493 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:41,494 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:41,494 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:41,494 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 403
02.12.2021 17:25:41,494 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 245
02.12.2021 17:25:41,494 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 242
02.12.2021 17:25:41,502 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 106
02.12.2021 17:25:41,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:41,523 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,523 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:41,523 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:41,523 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:41,523 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:41,523 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:41,523 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:41,523 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:41,523 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:41,523 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:41,523 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:41,523 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,523 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,523 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,523 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,523 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,523 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,523 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:41,528 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:41,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:41,529 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:41,529 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:41,529 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:41,529 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:41,529 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:41,529 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:41,529 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:41,529 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:41,529 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4] State transition from REBALANCING to RUNNING
02.12.2021 17:25:41,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:41,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,529 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,530 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:41,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 160
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:41,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 141
02.12.2021 17:25:41,603 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 5
02.12.2021 17:25:41,609 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:41,609 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,610 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,611 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:41,624 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:41,631 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:41,659 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119526ms for 120000ms of delay, sleeping for 484ms
02.12.2021 17:25:41,696 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:41,695 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 41
02.12.2021 17:25:41,694 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 59
02.12.2021 17:25:41,711 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:41,710 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:41,725 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:41,732 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:41,738 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:41,757 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:41,757 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:41,757 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Transiting to restore active tasks: {}
02.12.2021 17:25:41,757 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:41,757 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Paused partitions [] from the restore consumer
02.12.2021 17:25:41,757 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:41,757 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Transiting to update standby tasks: {}
02.12.2021 17:25:41,757 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:41,757 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Resumed partitions [] from the restore consumer
02.12.2021 17:25:41,757 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:41,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Initialization call done. State is RUNNING
02.12.2021 17:25:41,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,758 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:41,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:41,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:41,759 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:41,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:41,762 INFO [org.apache.kafka.streams.processor.internals.StreamThread:555] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Triggering the followup rebalance scheduled for 0 ms.
02.12.2021 17:25:41,764 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:41,759 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:41,764 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 59 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d
02.12.2021 17:25:41,768 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:41,766 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:41,770 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:41,772 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 70, -39, -14, -119, 6, 48, 75, 25, -73, -14, -59, -98, 2, 41, -103, 6, 0, 0, 0, 0, 0, 0, 0, 0, 24, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:41,771 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:41,775 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:41,773 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=52) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:41,779 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 485
02.12.2021 17:25:41,775 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:41,784 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:41,784 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:41,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:41,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,785 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,789 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,789 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,789 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,789 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,789 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,789 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:41,794 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:41,796 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:41,811 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:41,813 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:41,831 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 193
02.12.2021 17:25:41,834 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:41,887 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59938ms delay out of 60000ms. Remaining 62ms. Executor queue at 0
02.12.2021 17:25:41,890 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59942ms for 60000ms of delay, sleeping for 68ms
02.12.2021 17:25:41,889 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:41,894 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:41,895 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:41,895 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:41,895 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:41,895 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:41,895 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:41,895 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:41,895 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:41,895 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:41,895 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906] State transition from REBALANCING to RUNNING
02.12.2021 17:25:41,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:41,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,895 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,895 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:41,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:41,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,914 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,914 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:41,914 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:41,932 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 91
02.12.2021 17:25:41,935 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:41,985 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59980ms for 60000ms of delay, sleeping for 30ms
02.12.2021 17:25:41,993 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 296
02.12.2021 17:25:41,998 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 397
02.12.2021 17:25:42,017 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:42,017 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:42,021 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59311ms for 60000ms of delay, sleeping for 699ms
02.12.2021 17:25:42,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:42,029 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,029 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,029 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,029 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,029 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,029 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,030 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,030 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:42,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 518 ms and fetched 0 records
02.12.2021 17:25:42,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,049 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,050 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:42,095 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 194
02.12.2021 17:25:42,098 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:42,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:42,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,113 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:42,118 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:42,130 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:42,145 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119996ms for 120000ms of delay, sleeping for 14ms
02.12.2021 17:25:42,151 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:42,161 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118962ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:42,195 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 94
02.12.2021 17:25:42,199 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:42,215 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:42,218 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:42,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:42,243 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:42,243 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:42,243 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=80) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8,group_instance_id=null}
02.12.2021 17:25:42,251 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:42,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:42,265 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,265 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:42,265 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,265 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:42,265 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,265 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:42,265 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:42,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:42,289 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:42,289 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,289 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,290 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:42,299 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:42,317 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:42,319 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:42,331 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:42,344 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=80): org.apache.kafka.common.requests.HeartbeatResponse@60de8aaa
02.12.2021 17:25:42,344 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:42,352 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:42,390 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:42,395 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:42,395 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,395 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,395 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,395 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,395 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,395 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,395 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,395 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:42,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:42,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,415 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:42,417 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:42,431 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:42,453 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:42,491 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:42,496 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:42,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:42,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:42,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:42,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,531 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,531 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:42,551 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:42,551 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,551 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,551 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,551 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,551 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,551 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,551 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,551 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:42,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:42,596 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:42,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:42,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,614 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,615 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:42,616 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:42,631 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:42,652 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:42,691 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:42,696 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:42,716 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:42,715 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:42,730 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58885ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:42,732 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:42,753 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:42,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:42,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,766 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:42,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:42,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:42,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:42,766 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:42,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:42,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,792 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,792 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:42,806 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 89
02.12.2021 17:25:42,819 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:42,819 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:42,832 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:42,853 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:42,893 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:42,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:42,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,896 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,896 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:42,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:42,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,915 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,915 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:42,919 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:42,932 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:42,953 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:42,993 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:42,996 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:43,016 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:43,020 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:43,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:43,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,032 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:43,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:43,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,052 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,052 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:43,093 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:43,097 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:43,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:43,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,116 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,117 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:43,116 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:43,132 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:43,152 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:43,161 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119962ms delay out of 120000ms. Remaining 38ms. Executor queue at 0
02.12.2021 17:25:43,162 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119789ms for 120000ms of delay, sleeping for 221ms
02.12.2021 17:25:43,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:43,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:43,218 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:43,218 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:43,233 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:43,252 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:43,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:43,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,267 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:43,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:43,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:43,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:43,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:43,293 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:43,293 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,293 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,293 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,293 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,293 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,293 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,293 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,293 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 170
02.12.2021 17:25:43,297 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:43,318 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:43,318 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:43,333 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:43,353 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:43,384 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119233ms for 120000ms of delay, sleeping for 777ms
02.12.2021 17:25:43,393 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 70
02.12.2021 17:25:43,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:43,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,397 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,397 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 68
02.12.2021 17:25:43,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:43,416 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,417 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,418 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:43,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,419 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:43,434 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:43,453 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:43,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,466 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,466 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,466 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,466 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,466 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:43,466 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:43,466 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:43,466 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=73) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b,group_instance_id=null}
02.12.2021 17:25:43,466 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:43,466 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 327
02.12.2021 17:25:43,466 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=73) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21,group_instance_id=null}
02.12.2021 17:25:43,467 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=73): org.apache.kafka.common.requests.HeartbeatResponse@2b86fb75
02.12.2021 17:25:43,467 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:43,467 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 431
02.12.2021 17:25:43,467 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 59 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b
02.12.2021 17:25:43,467 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=73): org.apache.kafka.common.requests.HeartbeatResponse@1b52f7e3
02.12.2021 17:25:43,467 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:43,467 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:43,467 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:43,467 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 59 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21
02.12.2021 17:25:43,467 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 70, -39, -14, -119, 6, 48, 75, 25, -73, -14, -59, -98, 2, 41, -103, 6, 0, 0, 0, 0, 0, 0, 0, 0, 24, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:43,467 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:43,467 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=74) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:43,467 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:43,468 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 325
02.12.2021 17:25:43,468 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 70, -39, -14, -119, 6, 48, 75, 25, -73, -14, -59, -98, 2, 41, -103, 6, 0, 0, 0, 0, 0, 0, 0, 0, 24, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:43,468 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=74) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:43,468 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 429
02.12.2021 17:25:43,519 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:43,519 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:43,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:43,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,532 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,533 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,533 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,533 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,533 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,533 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:43,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:43,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,556 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,558 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,558 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:43,566 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:43,567 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:43,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:43,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,619 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,620 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:43,620 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:43,633 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:43,659 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:43,720 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:43,720 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:43,733 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:43,733 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59888ms delay out of 60000ms. Remaining 112ms. Executor queue at 0
02.12.2021 17:25:43,756 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59022ms for 60000ms of delay, sleeping for 988ms
02.12.2021 17:25:43,759 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:43,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:43,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,780 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:43,781 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,781 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:43,781 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,781 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:43,781 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:43,785 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:43,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:43,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,795 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,803 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 493
02.12.2021 17:25:43,821 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:43,822 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:43,844 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 189
02.12.2021 17:25:43,860 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:43,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:43,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,898 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,899 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:43,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:43,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,920 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,920 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 353
02.12.2021 17:25:43,922 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:43,944 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 89
02.12.2021 17:25:43,960 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:44,020 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 253
02.12.2021 17:25:44,023 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:44,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:44,034 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,034 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,034 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,034 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,034 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,034 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,034 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,034 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 159
02.12.2021 17:25:44,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:44,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,058 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,058 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 134
02.12.2021 17:25:44,121 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 152
02.12.2021 17:25:44,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,121 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,121 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 74
02.12.2021 17:25:44,134 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 59
02.12.2021 17:25:44,159 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 33
02.12.2021 17:25:44,163 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119517ms for 120000ms of delay, sleeping for 493ms
02.12.2021 17:25:44,192 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:44,192 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,193 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 191 and member id staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:44,194 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=72) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf,group_instance_id=null}
02.12.2021 17:25:44,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 365
02.12.2021 17:25:44,194 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=72): org.apache.kafka.common.requests.HeartbeatResponse@40da9ff8
02.12.2021 17:25:44,195 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:44,195 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 191 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf
02.12.2021 17:25:44,195 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:44,195 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:44,195 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 123, -60, 27, -87, -99, 46, 69, 70, -123, -109, 86, 85, 111, -45, 14, -12, 0, 0, 0, 0, 0, 0, 0, 0, 24, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:44,195 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=73) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:44,196 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 362
02.12.2021 17:25:44,196 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:44,196 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:44,196 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=68) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42,group_instance_id=null}
02.12.2021 17:25:44,193 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:44,197 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 191 and member id staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:44,197 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=72) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82,group_instance_id=null}
02.12.2021 17:25:44,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 337
02.12.2021 17:25:44,196 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 425
02.12.2021 17:25:44,198 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=68): org.apache.kafka.common.requests.HeartbeatResponse@585aaaf8
02.12.2021 17:25:44,197 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=72): org.apache.kafka.common.requests.HeartbeatResponse@6e8b487e
02.12.2021 17:25:44,199 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:44,198 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:44,200 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 423
02.12.2021 17:25:44,200 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 421
02.12.2021 17:25:44,199 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 191 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82
02.12.2021 17:25:44,201 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:44,201 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:44,201 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 123, -60, 27, -87, -99, 46, 69, 70, -123, -109, 86, 85, 111, -45, 14, -12, 0, 0, 0, 0, 0, 0, 0, 0, 24, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:44,202 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=73) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:44,202 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 332
02.12.2021 17:25:44,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 52
02.12.2021 17:25:44,274 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:44,274 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:44,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,274 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=68) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422,group_instance_id=null}
02.12.2021 17:25:44,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 146
02.12.2021 17:25:44,275 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=68): org.apache.kafka.common.requests.HeartbeatResponse@2b42c505
02.12.2021 17:25:44,275 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:44,275 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 145
02.12.2021 17:25:44,275 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 145
02.12.2021 17:25:44,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:44,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,286 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:44,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:44,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:44,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:44,286 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:44,294 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:44,297 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:44,301 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 320
02.12.2021 17:25:44,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 515 ms and fetched 0 records
02.12.2021 17:25:44,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,310 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,311 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:44,376 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 45
02.12.2021 17:25:44,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,400 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,401 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:44,401 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 220
02.12.2021 17:25:44,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,421 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,421 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:44,501 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 120
02.12.2021 17:25:44,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:44,535 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,537 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,538 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:44,558 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:44,558 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,558 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,558 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,558 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,558 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,558 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,558 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,558 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:44,602 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 20
02.12.2021 17:25:44,622 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:44,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,622 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,622 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:44,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 10 records with 35 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:44,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 106182ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:44,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:44,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 36 iterations.
02.12.2021 17:25:44,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 0 records with 36 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:44,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 106182ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:44,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:44,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:44,662 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=64): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', members=[])
02.12.2021 17:25:44,662 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', members=[])
02.12.2021 17:25:44,665 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:44,665 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=191, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', protocol='stream'}
02.12.2021 17:25:44,665 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=191, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=191, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:44,666 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=65) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336,group_instance_id=null,assignments=[]}
02.12.2021 17:25:44,666 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1001793, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:44,671 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1001803, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:44,675 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=65): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:44,680 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Main Consumer poll completed in 18 ms and fetched 10 records
02.12.2021 17:25:44,698 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] task [0_8] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-8, new queue size is 10
02.12.2021 17:25:44,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,699 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:44,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 36 iterations.
02.12.2021 17:25:44,707 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119906ms for 120000ms of delay, sleeping for 104ms
02.12.2021 17:25:44,722 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:44,723 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:44,752 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59634ms for 60000ms of delay, sleeping for 376ms
02.12.2021 17:25:44,766 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=191, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', protocol='stream'}
02.12.2021 17:25:44,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,787 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:44,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:44,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:44,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:44,790 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:44,811 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,814 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,815 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,818 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119975ms for 120000ms of delay, sleeping for 35ms
02.12.2021 17:25:44,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,821 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:44,823 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:44,823 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:44,857 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119996ms for 120000ms of delay, sleeping for 14ms
02.12.2021 17:25:44,873 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119582ms for 120000ms of delay, sleeping for 428ms
02.12.2021 17:25:44,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:44,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,902 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,902 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:44,921 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:44,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,922 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,922 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:44,929 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:45,023 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:45,029 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:45,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:45,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,039 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,039 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:45,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,059 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:45,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:45,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,123 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,123 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:45,123 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:45,131 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59326ms for 60000ms of delay, sleeping for 684ms
02.12.2021 17:25:45,223 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:45,223 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:45,249 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:45,249 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:45,249 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=81) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8,group_instance_id=null}
02.12.2021 17:25:45,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:45,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,291 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:45,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:45,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:45,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:45,292 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:45,302 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119652ms for 120000ms of delay, sleeping for 358ms
02.12.2021 17:25:45,322 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,323 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,323 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:45,323 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:45,324 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:45,349 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=81): org.apache.kafka.common.requests.HeartbeatResponse@1c662c29
02.12.2021 17:25:45,350 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:45,403 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,403 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,403 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,403 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,403 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,403 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,403 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,403 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,403 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:45,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:45,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,423 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,423 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:45,424 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:45,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:45,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:45,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:45,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,550 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,550 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:45,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:45,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,562 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,565 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:45,613 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=52): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', members=[])
02.12.2021 17:25:45,613 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', members=[])
02.12.2021 17:25:45,613 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=74): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', members=[])
02.12.2021 17:25:45,621 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', members=[])
02.12.2021 17:25:45,621 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:45,622 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=60, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', protocol='stream'}
02.12.2021 17:25:45,622 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=60, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=60, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:45,623 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=75) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21,group_instance_id=null,assignments=[]}
02.12.2021 17:25:45,623 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 280
02.12.2021 17:25:45,613 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=74): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', members=[])
02.12.2021 17:25:45,616 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:45,629 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=60, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', protocol='stream'}
02.12.2021 17:25:45,629 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=60, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=60, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:45,630 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=53) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d,group_instance_id=null,assignments=[]}
02.12.2021 17:25:45,624 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:45,624 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,623 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', members=[])
02.12.2021 17:25:45,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,630 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 162
02.12.2021 17:25:45,631 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,631 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:45,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30118ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:45,637 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,636 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=60, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', protocol='stream'}
02.12.2021 17:25:45,644 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:45,645 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=60, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=60, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:45,661 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=75) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b,group_instance_id=null,assignments=[]}
02.12.2021 17:25:45,661 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 162
02.12.2021 17:25:45,705 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119584ms for 120000ms of delay, sleeping for 426ms
02.12.2021 17:25:45,731 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:45,746 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:45,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:45,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,796 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:45,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:45,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:45,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:45,800 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:45,816 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 10 records with 14 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,816 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:45,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 15 iterations.
02.12.2021 17:25:45,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 0 records with 15 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:45,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:45,817 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1140763, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:45,820 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1140773, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:45,820 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Main Consumer poll completed in 3 ms and fetched 10 records
02.12.2021 17:25:45,820 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-3, new queue size is 10
02.12.2021 17:25:45,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,823 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:45,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,825 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,825 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:45,821 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:45,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 15 iterations.
02.12.2021 17:25:45,833 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59777ms for 60000ms of delay, sleeping for 233ms
02.12.2021 17:25:45,837 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 86
02.12.2021 17:25:45,846 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:45,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:45,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,904 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,904 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:45,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:45,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,923 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30225ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:45,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:45,947 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:46,024 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:46,048 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:46,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,051 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,051 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:46,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:46,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,066 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,066 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:46,068 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59936ms for 60000ms of delay, sleeping for 74ms
02.12.2021 17:25:46,124 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:46,133 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118908ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:46,143 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59156ms for 60000ms of delay, sleeping for 854ms
02.12.2021 17:25:46,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:46,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,144 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,144 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:46,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:46,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:46,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:46,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,306 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:46,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:46,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:46,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:46,307 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:46,325 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:46,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,326 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,326 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:46,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:46,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,406 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,407 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,407 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,407 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,407 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,407 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,407 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:46,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:46,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,424 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,424 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:46,445 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:46,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:46,546 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:46,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,552 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,552 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:46,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,567 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,567 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:46,625 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:46,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:46,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,644 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,645 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,645 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,645 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:46,726 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:46,745 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:46,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,808 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:46,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:46,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:46,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:46,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:46,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,827 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,827 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:46,827 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:46,846 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:46,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,908 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,908 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:46,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,925 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 349
02.12.2021 17:25:46,946 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:47,001 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59943ms for 60000ms of delay, sleeping for 67ms
02.12.2021 17:25:47,025 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 249
02.12.2021 17:25:47,047 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:47,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,053 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,053 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:47,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,068 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,068 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:47,071 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59610ms for 60000ms of delay, sleeping for 400ms
02.12.2021 17:25:47,126 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 148
02.12.2021 17:25:47,133 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119908ms delay out of 120000ms. Remaining 92ms. Executor queue at 0
02.12.2021 17:25:47,134 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118865ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:47,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:47,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,145 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,145 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 51
02.12.2021 17:25:47,162 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=75): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,162 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,162 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=60, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b', protocol='stream'}
02.12.2021 17:25:47,162 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=53): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 5, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,163 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 5, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,162 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=75): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,163 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,163 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=60, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21', protocol='stream'}
02.12.2021 17:25:47,163 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 60 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21
02.12.2021 17:25:47,163 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:47,163 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:47,163 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:47,163 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:47,164 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:47,164 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906] State transition from RUNNING to REBALANCING
02.12.2021 17:25:47,164 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:47,164 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 245
02.12.2021 17:25:47,163 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=60, memberId='staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d', protocol='stream'}
02.12.2021 17:25:47,162 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 60 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b
02.12.2021 17:25:47,164 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:47,164 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:47,164 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:47,164 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 60 and memberId staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d
02.12.2021 17:25:47,165 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:47,165 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:47,165 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:47,165 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:47,165 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[redacted.Cloud.Message.Callback.Retry3-5], userDataSize=48)
02.12.2021 17:25:47,165 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 165
02.12.2021 17:25:47,165 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:47,170 DEBUG [org.apache.kafka.streams.processor.internals.ProcessorStateManager:192] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] task [0_5] Created state store manager for task 0_5
02.12.2021 17:25:47,170 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1.task.0_5.s.dropped-records
02.12.2021 17:25:47,171 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=dropped-records-rate, group=stream-task-metrics, description=The average number of dropped records per second, tags={thread-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:47,171 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=dropped-records-total, group=stream-task-metrics, description=The total number of dropped records, tags={thread-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:47,189 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1.task.0_5.s.enforced-processing
02.12.2021 17:25:47,189 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=enforced-processing-rate, group=stream-task-metrics, description=The average number of occurrences of enforced-processing operations per second, tags={thread-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:47,189 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=enforced-processing-total, group=stream-task-metrics, description=The total number of occurrences of enforced-processing operations, tags={thread-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:47,189 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1.task.0_5.s.active-process-ratio
02.12.2021 17:25:47,189 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=active-process-ratio, group=stream-task-metrics, description=The fraction of time the thread spent on processing this task among all assigned active tasks, tags={thread-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:47,190 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1.task.0_5.s.process-latency
02.12.2021 17:25:47,190 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=process-latency-avg, group=stream-task-metrics, description=The average latency of calls to process, tags={thread-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:47,190 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=process-latency-max, group=stream-task-metrics, description=The maximum latency of calls to process, tags={thread-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:47,190 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1.task.0_5.s.punctuate
02.12.2021 17:25:47,190 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=punctuate-latency-avg, group=stream-task-metrics, description=The average latency of calls to punctuate, tags={thread-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:47,190 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=punctuate-latency-max, group=stream-task-metrics, description=The maximum latency of calls to punctuate, tags={thread-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:47,190 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=punctuate-rate, group=stream-task-metrics, description=The average number of calls to punctuate per second, tags={thread-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:47,190 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=punctuate-total, group=stream-task-metrics, description=The total number of calls to punctuate, tags={thread-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:47,190 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1.task.0_5.s.active-buffer-count
02.12.2021 17:25:47,190 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=active-buffer-count, group=stream-task-metrics, description=The count of buffered records that are polled from consumer and not yet processed for this active task, tags={thread-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:47,190 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1.task.0_5.node.Processor.s.Processor-record-e2e-latency
02.12.2021 17:25:47,190 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=record-e2e-latency-avg, group=stream-processor-node-metrics, description=The average end-to-end latency of a record, measuring by comparing the record timestamp with the system time when it has been fully processed by the node, tags={thread-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1, task-id=0_5, processor-node-id=Processor}]
02.12.2021 17:25:47,191 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=record-e2e-latency-max, group=stream-processor-node-metrics, description=The maximum end-to-end latency of a record, measuring by comparing the record timestamp with the system time when it has been fully processed by the node, tags={thread-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1, task-id=0_5, processor-node-id=Processor}]
02.12.2021 17:25:47,191 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=record-e2e-latency-min, group=stream-processor-node-metrics, description=The minimum end-to-end latency of a record, measuring by comparing the record timestamp with the system time when it has been fully processed by the node, tags={thread-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1, task-id=0_5, processor-node-id=Processor}]
02.12.2021 17:25:47,191 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1.task.0_5.node.Source.s.Source-record-e2e-latency
02.12.2021 17:25:47,191 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=record-e2e-latency-avg, group=stream-processor-node-metrics, description=The average end-to-end latency of a record, measuring by comparing the record timestamp with the system time when it has been fully processed by the node, tags={thread-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1, task-id=0_5, processor-node-id=Source}]
02.12.2021 17:25:47,191 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=record-e2e-latency-max, group=stream-processor-node-metrics, description=The maximum end-to-end latency of a record, measuring by comparing the record timestamp with the system time when it has been fully processed by the node, tags={thread-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1, task-id=0_5, processor-node-id=Source}]
02.12.2021 17:25:47,191 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=record-e2e-latency-min, group=stream-processor-node-metrics, description=The minimum end-to-end latency of a record, measuring by comparing the record timestamp with the system time when it has been fully processed by the node, tags={thread-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1, task-id=0_5, processor-node-id=Source}]
02.12.2021 17:25:47,191 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1.task.0_5.s.record-lateness
02.12.2021 17:25:47,191 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=record-lateness-avg, group=stream-task-metrics, description=The observed average lateness of records in milliseconds, measured by comparing the record timestamp with the current stream time, tags={thread-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:47,191 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=record-lateness-max, group=stream-task-metrics, description=The observed maximum lateness of records in milliseconds, measured by comparing the record timestamp with the current stream time, tags={thread-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:47,191 DEBUG [org.apache.kafka.streams.processor.internals.ProcessorStateManager:208] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] task [0_5] Register global stores []
02.12.2021 17:25:47,191 TRACE [org.apache.kafka.streams.processor.internals.StreamThread:246] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Created task 0_5 with assigned partitions [redacted.Cloud.Message.Callback.Retry3-5]
02.12.2021 17:25:47,192 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: redacted.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:47,192 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:47,192 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Pausing partitions [redacted.Cloud.Message.Callback.Retry3-5]
02.12.2021 17:25:47,192 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1288] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Fetching committed offsets for partitions: [redacted.Cloud.Message.Callback.Retry3-5]
02.12.2021 17:25:47,192 TRACE [org.apache.kafka.common.requests.OffsetFetchRequest:93] Fallback the requireStable flag to false as broker only supports OffsetFetchRequest version 5. Need v7 or newer to enable this feature
02.12.2021 17:25:47,192 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending OFFSET_FETCH request with header RequestHeader(apiKey=OFFSET_FETCH, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=54) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,topics=[{name=redacted.Cloud.Message.Callback.Retry3,partition_indexes=[5]}]}
02.12.2021 17:25:47,196 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:47,196 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:47,197 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=69) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42,group_instance_id=null}
02.12.2021 17:25:47,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 449
02.12.2021 17:25:47,197 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=69): org.apache.kafka.common.requests.HeartbeatResponse@c862b2d
02.12.2021 17:25:47,197 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:47,197 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received OFFSET_FETCH response from node 2147483643 for request with header RequestHeader(apiKey=OFFSET_FETCH, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=54): org.apache.kafka.common.requests.OffsetFetchResponse@10e9cf1d
02.12.2021 17:25:47,205 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:820] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Setting offset for partition redacted.Cloud.Message.Callback.Retry3-5 to the committed offset FetchPosition{offset=967826, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null)], epoch=absent}}
02.12.2021 17:25:47,205 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=preferred-read-replica, group=consumer-fetch-manager-metrics, description=The current read replica for the partition, or -1 if reading from leader, tags={client-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=5}]
02.12.2021 17:25:47,205 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 100
02.12.2021 17:25:47,205 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 103
02.12.2021 17:25:47,204 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 448
02.12.2021 17:25:47,206 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 439
02.12.2021 17:25:47,227 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 47
02.12.2021 17:25:47,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 144
02.12.2021 17:25:47,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 61
02.12.2021 17:25:47,274 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:47,274 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:47,274 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=69) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422,group_instance_id=null}
02.12.2021 17:25:47,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:47,276 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=69): org.apache.kafka.common.requests.HeartbeatResponse@2c765a74
02.12.2021 17:25:47,276 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:47,276 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 149
02.12.2021 17:25:47,276 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 149
02.12.2021 17:25:47,306 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 2
02.12.2021 17:25:47,308 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:47,308 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:47,308 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Transiting to restore active tasks: {}
02.12.2021 17:25:47,308 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:47,308 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Paused partitions [] from the restore consumer
02.12.2021 17:25:47,308 INFO [org.apache.kafka.streams.processor.internals.StreamTask:218] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] task [0_5] Initialized
02.12.2021 17:25:47,308 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1288] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Fetching committed offsets for partitions: [redacted.Cloud.Message.Callback.Retry3-5]
02.12.2021 17:25:47,309 TRACE [org.apache.kafka.common.requests.OffsetFetchRequest:93] Fallback the requireStable flag to false as broker only supports OffsetFetchRequest version 5. Need v7 or newer to enable this feature
02.12.2021 17:25:47,309 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending OFFSET_FETCH request with header RequestHeader(apiKey=OFFSET_FETCH, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=55) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,topics=[{name=redacted.Cloud.Message.Callback.Retry3,partition_indexes=[5]}]}
02.12.2021 17:25:47,309 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received OFFSET_FETCH response from node 2147483643 for request with header RequestHeader(apiKey=OFFSET_FETCH, apiVersion=5, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=55): org.apache.kafka.common.requests.OffsetFetchResponse@77649f05
02.12.2021 17:25:47,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:839] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] task [0_5] A committed timestamp was detected: setting the partition time of partition redacted.Cloud.Message.Callback.Retry3-5 to 1638462101869 in stream task 0_5
02.12.2021 17:25:47,309 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:868] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] task [0_5] Initializing processor nodes of the topology
02.12.2021 17:25:47,309 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1.task.0_5.s.process
02.12.2021 17:25:47,310 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=process-rate, group=stream-task-metrics, description=The average number of calls to process per second, tags={thread-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:47,310 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=process-total, group=stream-task-metrics, description=The total number of calls to process, tags={thread-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:47,310 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1.task.0_5.node.Source.s.process
02.12.2021 17:25:47,310 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=process-rate, group=stream-processor-node-metrics, description=The average number of calls to process per second, tags={thread-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1, task-id=0_5, processor-node-id=Source}]
02.12.2021 17:25:47,310 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=process-total, group=stream-processor-node-metrics, description=The total number of calls to process, tags={thread-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1, task-id=0_5, processor-node-id=Source}]
02.12.2021 17:25:47,310 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1.task.0_5.node.Source.s.punctuate
02.12.2021 17:25:47,310 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1.task.0_5.node.Source.s.create
02.12.2021 17:25:47,310 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1.task.0_5.node.Source.s.destroy
02.12.2021 17:25:47,310 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1.task.0_5.node.ThrottleableProcessor.s.process
02.12.2021 17:25:47,310 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1.task.0_5.node.ThrottleableProcessor.s.punctuate
02.12.2021 17:25:47,310 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1.task.0_5.node.ThrottleableProcessor.s.create
02.12.2021 17:25:47,311 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1.task.0_5.node.ThrottleableProcessor.s.destroy
02.12.2021 17:25:47,311 INFO [com.sigfox.kafka.throttleable.ThrottleableStreamProcessor:36] Stream 'staging-message-processor-retry3' task '0_5': pausable processor starting
02.12.2021 17:25:47,311 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1.task.0_5.node.Processor.s.process
02.12.2021 17:25:47,311 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1.task.0_5.node.Processor.s.punctuate
02.12.2021 17:25:47,311 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1.task.0_5.node.Processor.s.create
02.12.2021 17:25:47,311 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1.task.0_5.node.Processor.s.destroy
02.12.2021 17:25:47,311 INFO [org.apache.kafka.streams.processor.internals.StreamTask:239] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] task [0_5] Restored and ready to run
02.12.2021 17:25:47,311 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Resuming partitions [redacted.Cloud.Message.Callback.Retry3-5]
02.12.2021 17:25:47,311 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Transiting to update standby tasks: {}
02.12.2021 17:25:47,311 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:47,311 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Resumed partitions [] from the restore consumer
02.12.2021 17:25:47,311 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:47,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Initialization call done. State is RUNNING
02.12.2021 17:25:47,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,311 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:47,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:47,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:47,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:47,311 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:1199] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Added READ_UNCOMMITTED fetch request for partition redacted.Cloud.Message.Callback.Retry3-5 at position FetchPosition{offset=967826, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null)], epoch=absent}} to node kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null)
02.12.2021 17:25:47,312 DEBUG [org.apache.kafka.clients.FetchSessionHandler:211] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Built full fetch (sessionId=INVALID, epoch=INITIAL) for node 3 with (redacted.Cloud.Message.Callback.Retry3-5).
02.12.2021 17:25:47,312 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:266] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending READ_UNCOMMITTED FullFetchRequest(redacted.Cloud.Message.Callback.Retry3-5) to broker kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null)
02.12.2021 17:25:47,312 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,312 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 333
02.12.2021 17:25:47,313 DEBUG [org.apache.kafka.clients.NetworkClient:1003] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Initiating connection to node kafka-4.data.sta.redacted:9093 (id: 3 rack: null) using address kafka-4.data.sta.par.eu.dc.sigfox.com/10.183.8.135
02.12.2021 17:25:47,314 DEBUG [org.apache.kafka.common.security.authenticator.SaslClientAuthenticator:409] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Set SASL client state to SEND_APIVERSIONS_REQUEST
02.12.2021 17:25:47,315 DEBUG [org.apache.kafka.common.security.authenticator.SaslClientAuthenticator:215] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Creating SaslClient: client=null;service=kafka;serviceHostname=kafka-4.data.sta.redacted;mechs=[PLAIN]
02.12.2021 17:25:47,320 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name node-3.requests-sent
02.12.2021 17:25:47,321 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=request-total, group=consumer-node-metrics, description=The total number of requests sent, tags={client-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, node-id=node-3}]
02.12.2021 17:25:47,321 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=request-rate, group=consumer-node-metrics, description=The number of requests sent per second, tags={client-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, node-id=node-3}]
02.12.2021 17:25:47,321 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=request-size-avg, group=consumer-node-metrics, description=The average size of requests sent., tags={client-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, node-id=node-3}]
02.12.2021 17:25:47,326 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=request-size-max, group=consumer-node-metrics, description=The maximum size of any request sent., tags={client-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, node-id=node-3}]
02.12.2021 17:25:47,327 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name node-3.bytes-sent
02.12.2021 17:25:47,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:47,328 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:47,328 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:47,328 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:47,328 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:47,328 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:47,328 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:47,328 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:47,328 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:47,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:47,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,328 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,328 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,329 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=outgoing-byte-total, group=consumer-node-metrics, description=The total number of outgoing bytes, tags={client-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, node-id=node-3}]
02.12.2021 17:25:47,331 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=outgoing-byte-rate, group=consumer-node-metrics, description=The number of outgoing bytes per second, tags={client-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, node-id=node-3}]
02.12.2021 17:25:47,331 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name node-3.responses-received
02.12.2021 17:25:47,331 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=response-total, group=consumer-node-metrics, description=The total number of responses received, tags={client-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, node-id=node-3}]
02.12.2021 17:25:47,331 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=response-rate, group=consumer-node-metrics, description=The number of responses received per second, tags={client-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, node-id=node-3}]
02.12.2021 17:25:47,331 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name node-3.bytes-received
02.12.2021 17:25:47,332 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=incoming-byte-total, group=consumer-node-metrics, description=The total number of incoming bytes, tags={client-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, node-id=node-3}]
02.12.2021 17:25:47,332 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=incoming-byte-rate, group=consumer-node-metrics, description=The number of incoming bytes per second, tags={client-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, node-id=node-3}]
02.12.2021 17:25:47,332 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name node-3.latency
02.12.2021 17:25:47,333 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=request-latency-avg, group=consumer-node-metrics, description=, tags={client-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, node-id=node-3}]
02.12.2021 17:25:47,333 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=request-latency-max, group=consumer-node-metrics, description=, tags={client-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, node-id=node-3}]
02.12.2021 17:25:47,333 DEBUG [org.apache.kafka.common.network.Selector:531] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 3
02.12.2021 17:25:47,349 TRACE [org.apache.kafka.common.network.SslTransportLayer:339] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake NEED_WRAP channelId 3, appReadBuffer pos 0, netReadBuffer pos 0, netWriteBuffer pos 0
02.12.2021 17:25:47,349 TRACE [org.apache.kafka.common.network.SslTransportLayer:472] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake handshakeWrap 3
02.12.2021 17:25:47,350 TRACE [org.apache.kafka.common.network.SslTransportLayer:356] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake NEED_WRAP channelId 3, handshakeResult Status = OK HandshakeStatus = NEED_UNWRAP
02.12.2021 17:25:47,353 TRACE [org.apache.kafka.common.network.SslTransportLayer:365] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake NEED_UNWRAP channelId 3, appReadBuffer pos 0, netReadBuffer pos 0, netWriteBuffer pos 464
02.12.2021 17:25:47,355 TRACE [org.apache.kafka.common.network.SslTransportLayer:499] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap 3
02.12.2021 17:25:47,355 TRACE [org.apache.kafka.common.network.SslTransportLayer:519] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap: handshakeStatus NEED_UNWRAP status BUFFER_UNDERFLOW
02.12.2021 17:25:47,355 TRACE [org.apache.kafka.common.network.SslTransportLayer:387] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake NEED_UNWRAP channelId 3, handshakeResult Status = BUFFER_UNDERFLOW HandshakeStatus = NEED_UNWRAP
02.12.2021 17:25:47,356 DEBUG [org.apache.kafka.clients.NetworkClient:955] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Completed connection to node 3. Fetching API versions.
02.12.2021 17:25:47,358 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-5 because previous request to kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null) has not been processed
02.12.2021 17:25:47,358 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 453
02.12.2021 17:25:47,358 TRACE [org.apache.kafka.common.network.SslTransportLayer:365] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake NEED_UNWRAP channelId 3, appReadBuffer pos 0, netReadBuffer pos 2230, netWriteBuffer pos 464
02.12.2021 17:25:47,358 TRACE [org.apache.kafka.common.network.SslTransportLayer:499] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap 3
02.12.2021 17:25:47,366 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 42
02.12.2021 17:25:47,368 TRACE [org.apache.kafka.common.network.SslTransportLayer:519] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap: handshakeStatus NEED_WRAP status OK
02.12.2021 17:25:47,368 TRACE [org.apache.kafka.common.network.SslTransportLayer:387] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake NEED_UNWRAP channelId 3, handshakeResult Status = OK HandshakeStatus = NEED_TASK
02.12.2021 17:25:47,368 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-5 because previous request to kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null) has not been processed
02.12.2021 17:25:47,368 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 443
02.12.2021 17:25:47,368 TRACE [org.apache.kafka.common.network.SslTransportLayer:339] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake NEED_WRAP channelId 3, appReadBuffer pos 0, netReadBuffer pos 0, netWriteBuffer pos 464
02.12.2021 17:25:47,368 TRACE [org.apache.kafka.common.network.SslTransportLayer:472] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake handshakeWrap 3
02.12.2021 17:25:47,368 TRACE [org.apache.kafka.common.network.SslTransportLayer:356] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake NEED_WRAP channelId 3, handshakeResult Status = OK HandshakeStatus = NEED_WRAP
02.12.2021 17:25:47,368 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-5 because previous request to kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null) has not been processed
02.12.2021 17:25:47,368 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 443
02.12.2021 17:25:47,368 TRACE [org.apache.kafka.common.network.SslTransportLayer:339] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake NEED_WRAP channelId 3, appReadBuffer pos 0, netReadBuffer pos 0, netWriteBuffer pos 75
02.12.2021 17:25:47,368 TRACE [org.apache.kafka.common.network.SslTransportLayer:472] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake handshakeWrap 3
02.12.2021 17:25:47,369 TRACE [org.apache.kafka.common.network.SslTransportLayer:356] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake NEED_WRAP channelId 3, handshakeResult Status = OK HandshakeStatus = NEED_WRAP
02.12.2021 17:25:47,369 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-5 because previous request to kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null) has not been processed
02.12.2021 17:25:47,369 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 442
02.12.2021 17:25:47,369 TRACE [org.apache.kafka.common.network.SslTransportLayer:339] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake NEED_WRAP channelId 3, appReadBuffer pos 0, netReadBuffer pos 0, netWriteBuffer pos 6
02.12.2021 17:25:47,369 TRACE [org.apache.kafka.common.network.SslTransportLayer:472] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake handshakeWrap 3
02.12.2021 17:25:47,369 TRACE [org.apache.kafka.common.network.SslTransportLayer:356] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake NEED_WRAP channelId 3, handshakeResult Status = OK HandshakeStatus = NEED_UNWRAP
02.12.2021 17:25:47,369 TRACE [org.apache.kafka.common.network.SslTransportLayer:365] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake NEED_UNWRAP channelId 3, appReadBuffer pos 0, netReadBuffer pos 0, netWriteBuffer pos 45
02.12.2021 17:25:47,369 TRACE [org.apache.kafka.common.network.SslTransportLayer:499] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap 3
02.12.2021 17:25:47,369 TRACE [org.apache.kafka.common.network.SslTransportLayer:519] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap: handshakeStatus NEED_UNWRAP status BUFFER_UNDERFLOW
02.12.2021 17:25:47,369 TRACE [org.apache.kafka.common.network.SslTransportLayer:387] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake NEED_UNWRAP channelId 3, handshakeResult Status = BUFFER_UNDERFLOW HandshakeStatus = NEED_UNWRAP
02.12.2021 17:25:47,369 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-5 because previous request to kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null) has not been processed
02.12.2021 17:25:47,369 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 442
02.12.2021 17:25:47,371 TRACE [org.apache.kafka.common.network.SslTransportLayer:365] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake NEED_UNWRAP channelId 3, appReadBuffer pos 0, netReadBuffer pos 6, netWriteBuffer pos 45
02.12.2021 17:25:47,371 TRACE [org.apache.kafka.common.network.SslTransportLayer:499] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap 3
02.12.2021 17:25:47,371 TRACE [org.apache.kafka.common.network.SslTransportLayer:519] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap: handshakeStatus NEED_UNWRAP status OK
02.12.2021 17:25:47,371 TRACE [org.apache.kafka.common.network.SslTransportLayer:387] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake NEED_UNWRAP channelId 3, handshakeResult Status = OK HandshakeStatus = NEED_UNWRAP
02.12.2021 17:25:47,374 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-5 because previous request to kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null) has not been processed
02.12.2021 17:25:47,374 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 437
02.12.2021 17:25:47,374 TRACE [org.apache.kafka.common.network.SslTransportLayer:365] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake NEED_UNWRAP channelId 3, appReadBuffer pos 0, netReadBuffer pos 45, netWriteBuffer pos 45
02.12.2021 17:25:47,375 TRACE [org.apache.kafka.common.network.SslTransportLayer:499] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap 3
02.12.2021 17:25:47,375 TRACE [org.apache.kafka.common.network.SslTransportLayer:519] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap: handshakeStatus FINISHED status OK
02.12.2021 17:25:47,375 TRACE [org.apache.kafka.common.network.SslTransportLayer:387] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake NEED_UNWRAP channelId 3, handshakeResult Status = OK HandshakeStatus = FINISHED
02.12.2021 17:25:47,375 DEBUG [org.apache.kafka.common.network.SslTransportLayer:452] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSL handshake completed successfully with peerHost 'kafka-4.data.sta.par.eu.dc.sigfox.com' peerPort 9093 peerPrincipal 'CN=*.sigfox.com, O=SIGFOX S.A, L=Labege, C=FR' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384'
02.12.2021 17:25:47,375 TRACE [org.apache.kafka.common.network.SslTransportLayer:458] [SslTransportLayer channelId=3 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-4.data.sta.redacted/10.183.8.135:9093], selector=sun.nio.ch.EPollSelectorImpl@f6dc81c, interestOps=8, readyOps=0] SSLHandshake FINISHED channelId 3, appReadBuffer pos 0, netReadBuffer pos 0, netWriteBuffer pos 45 
02.12.2021 17:25:47,375 DEBUG [org.apache.kafka.common.security.authenticator.SaslClientAuthenticator:409] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE
02.12.2021 17:25:47,376 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-5 because previous request to kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null) has not been processed
02.12.2021 17:25:47,376 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 435
02.12.2021 17:25:47,376 DEBUG [org.apache.kafka.common.security.authenticator.SaslClientAuthenticator:409] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Set SASL client state to SEND_HANDSHAKE_REQUEST
02.12.2021 17:25:47,376 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 49
02.12.2021 17:25:47,376 DEBUG [org.apache.kafka.common.security.authenticator.SaslClientAuthenticator:409] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE
02.12.2021 17:25:47,376 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-5 because previous request to kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null) has not been processed
02.12.2021 17:25:47,377 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 435
02.12.2021 17:25:47,377 DEBUG [org.apache.kafka.common.security.authenticator.SaslClientAuthenticator:409] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Set SASL client state to INITIAL
02.12.2021 17:25:47,378 DEBUG [org.apache.kafka.common.security.authenticator.SaslClientAuthenticator:409] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Set SASL client state to INTERMEDIATE
02.12.2021 17:25:47,378 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-5 because previous request to kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null) has not been processed
02.12.2021 17:25:47,378 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 433
02.12.2021 17:25:47,378 DEBUG [org.apache.kafka.common.security.authenticator.SaslClientAuthenticator:409] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Set SASL client state to COMPLETE
02.12.2021 17:25:47,378 DEBUG [org.apache.kafka.common.security.authenticator.SaslClientAuthenticator:685] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Finished authentication with no session expiration and no session re-authentication
02.12.2021 17:25:47,378 DEBUG [org.apache.kafka.common.network.Selector:560] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully authenticated with kafka-4.data.sta.redacted/10.183.8.135
02.12.2021 17:25:47,379 DEBUG [org.apache.kafka.clients.NetworkClient:969] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Initiating API versions fetch from node 3.
02.12.2021 17:25:47,379 TRACE [org.apache.kafka.clients.NetworkClient:493] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] No version information found when sending API_VERSIONS with correlation id 57 to node 3. Assuming version 3.
02.12.2021 17:25:47,384 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending API_VERSIONS request with header RequestHeader(apiKey=API_VERSIONS, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=57) and timeout 30000 to node 3: {client_software_name=apache-kafka-java,client_software_version=2.7.0,_tagged_fields={}}
02.12.2021 17:25:47,386 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-5 because previous request to kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null) has not been processed
02.12.2021 17:25:47,386 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 425
02.12.2021 17:25:47,386 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-5 because previous request to kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null) has not been processed
02.12.2021 17:25:47,388 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 425
02.12.2021 17:25:47,392 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received API_VERSIONS response from node 3 for request with header RequestHeader(apiKey=API_VERSIONS, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=57): org.apache.kafka.common.requests.ApiVersionsResponse@3c4ee6b0
02.12.2021 17:25:47,392 DEBUG [org.apache.kafka.clients.NetworkClient:969] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Initiating API versions fetch from node 3.
02.12.2021 17:25:47,392 TRACE [org.apache.kafka.clients.NetworkClient:493] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] No version information found when sending API_VERSIONS with correlation id 58 to node 3. Assuming version 0.
02.12.2021 17:25:47,392 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending API_VERSIONS request with header RequestHeader(apiKey=API_VERSIONS, apiVersion=0, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=58) and timeout 30000 to node 3: {}
02.12.2021 17:25:47,392 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-5 because previous request to kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null) has not been processed
02.12.2021 17:25:47,392 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 419
02.12.2021 17:25:47,392 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-5 because previous request to kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null) has not been processed
02.12.2021 17:25:47,393 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 419
02.12.2021 17:25:47,393 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received API_VERSIONS response from node 3 for request with header RequestHeader(apiKey=API_VERSIONS, apiVersion=0, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=58): org.apache.kafka.common.requests.ApiVersionsResponse@546ff2c
02.12.2021 17:25:47,394 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending FETCH request with header RequestHeader(apiKey=FETCH, apiVersion=11, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=56) and timeout 30000 to node 3: {replica_id=-1,max_wait_ms=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=0,session_epoch=0,topics=[{topic=redacted.Cloud.Message.Callback.Retry3,partitions=[{partition=5,current_leader_epoch=-1,fetch_offset=967826,log_start_offset=-1,partition_max_bytes=1048576}]}],forgotten_topics_data=[],rack_id=}
02.12.2021 17:25:47,394 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-5 because previous request to kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null) has not been processed
02.12.2021 17:25:47,394 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 417
02.12.2021 17:25:47,394 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-5 because previous request to kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null) has not been processed
02.12.2021 17:25:47,394 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 417
02.12.2021 17:25:47,394 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-5 because previous request to kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null) has not been processed
02.12.2021 17:25:47,394 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 417
02.12.2021 17:25:47,395 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-5 because previous request to kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null) has not been processed
02.12.2021 17:25:47,395 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 416
02.12.2021 17:25:47,395 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-5 because previous request to kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null) has not been processed
02.12.2021 17:25:47,395 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 416
02.12.2021 17:25:47,395 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-5 because previous request to kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null) has not been processed
02.12.2021 17:25:47,395 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 416
02.12.2021 17:25:47,395 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-5 because previous request to kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null) has not been processed
02.12.2021 17:25:47,396 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 416
02.12.2021 17:25:47,396 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-5 because previous request to kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null) has not been processed
02.12.2021 17:25:47,396 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 415
02.12.2021 17:25:47,396 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-5 because previous request to kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null) has not been processed
02.12.2021 17:25:47,397 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 415
02.12.2021 17:25:47,397 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-5 because previous request to kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null) has not been processed
02.12.2021 17:25:47,397 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 414
02.12.2021 17:25:47,397 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-5 because previous request to kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null) has not been processed
02.12.2021 17:25:47,404 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 414
02.12.2021 17:25:47,404 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-5 because previous request to kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null) has not been processed
02.12.2021 17:25:47,404 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 407
02.12.2021 17:25:47,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:47,409 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:47,410 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:47,410 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:47,410 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:47,410 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:47,410 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:47,410 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:47,410 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:47,410 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906] State transition from REBALANCING to RUNNING
02.12.2021 17:25:47,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:47,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,410 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,410 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,408 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received FETCH response from node 3 for request with header RequestHeader(apiKey=FETCH, apiVersion=11, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=56): org.apache.kafka.common.requests.FetchResponse@785ddab6
02.12.2021 17:25:47,412 DEBUG [org.apache.kafka.clients.FetchSessionHandler:440] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Node 3 sent a full fetch response that created a new incremental fetch session 583358834 with response=(redacted.Cloud.Message.Callback.Retry3-5)
02.12.2021 17:25:47,412 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:315] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Fetch READ_UNCOMMITTED at offset 967826 for partition redacted.Cloud.Message.Callback.Retry3-5 returned fetch data (error=NONE, highWaterMark=968501, lastStableOffset = 968501, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, divergingEpoch =Optional.empty, recordsSizeInBytes=302324)
02.12.2021 17:25:47,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 232
02.12.2021 17:25:47,414 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1251] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Preparing to read 302324 bytes of data for partition redacted.Cloud.Message.Callback.Retry3-5 with offset FetchPosition{offset=967826, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 3 rack: null)], epoch=absent}}
02.12.2021 17:25:47,415 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1275] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Updating high watermark for partition redacted.Cloud.Message.Callback.Retry3-5 to 968501
02.12.2021 17:25:47,416 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1280] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Updating log start offset for partition redacted.Cloud.Message.Callback.Retry3-5 to 0
02.12.2021 17:25:47,416 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1285] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Updating last stable offset for partition redacted.Cloud.Message.Callback.Retry3-5 to 968501
02.12.2021 17:25:47,417 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=967826, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:47,417 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=967836, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:47,423 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name redacted.Cloud.Message.Callback.Retry3-5.records-lag
02.12.2021 17:25:47,423 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=records-lag, group=consumer-fetch-manager-metrics, description=The latest lag of the partition, tags={client-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=5}]
02.12.2021 17:25:47,423 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=records-lag-max, group=consumer-fetch-manager-metrics, description=The max lag of the partition, tags={client-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=5}]
02.12.2021 17:25:47,424 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=records-lag-avg, group=consumer-fetch-manager-metrics, description=The average lag of the partition, tags={client-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=5}]
02.12.2021 17:25:47,424 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name redacted.Cloud.Message.Callback.Retry3-5.records-lead
02.12.2021 17:25:47,424 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=records-lead, group=consumer-fetch-manager-metrics, description=The latest lead of the partition, tags={client-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=5}]
02.12.2021 17:25:47,424 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=records-lead-min, group=consumer-fetch-manager-metrics, description=The min lead of the partition, tags={client-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=5}]
02.12.2021 17:25:47,424 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=records-lead-avg, group=consumer-fetch-manager-metrics, description=The average lead of the partition, tags={client-id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=5}]
02.12.2021 17:25:47,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 113 ms and fetched 10 records
02.12.2021 17:25:47,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,426 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,426 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:47,426 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-5, new queue size is 10
02.12.2021 17:25:47,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,426 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:47,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 1 iterations.
02.12.2021 17:25:47,429 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:47,430 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 1 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:47,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 2 iterations.
02.12.2021 17:25:47,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 2 records with 2 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:47,461 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 3 iterations.
02.12.2021 17:25:47,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 3 records with 3 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:47,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 4 iterations.
02.12.2021 17:25:47,482 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59554ms for 60000ms of delay, sleeping for 456ms
02.12.2021 17:25:47,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 4 records with 4 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:47,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 5 iterations.
02.12.2021 17:25:47,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 5 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:47,492 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:47,492 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=967836, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:47,492 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=967846, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:47,492 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:47,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 389
02.12.2021 17:25:47,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 125
02.12.2021 17:25:47,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:47,524 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-5, new queue size is 10
02.12.2021 17:25:47,530 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:47,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,541 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name topic.redacted.Cloud.Message.Callback.Exhausted.records-per-batch
02.12.2021 17:25:47,542 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name topic.redacted.Cloud.Message.Callback.Exhausted.bytes
02.12.2021 17:25:47,542 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name topic.redacted.Cloud.Message.Callback.Exhausted.compression-rate
02.12.2021 17:25:47,542 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name topic.redacted.Cloud.Message.Callback.Exhausted.record-retries
02.12.2021 17:25:47,542 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name topic.redacted.Cloud.Message.Callback.Exhausted.record-errors
02.12.2021 17:25:47,539 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:47,547 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,547 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 5 iterations.
02.12.2021 17:25:47,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,566 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,567 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:47,576 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name node-2.requests-sent
02.12.2021 17:25:47,576 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name node-2.bytes-sent
02.12.2021 17:25:47,577 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name node-2.responses-received
02.12.2021 17:25:47,577 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name node-2.bytes-received
02.12.2021 17:25:47,578 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name node-2.latency
02.12.2021 17:25:47,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,582 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 5 records with 5 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:47,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 499
02.12.2021 17:25:47,591 TRACE [org.apache.kafka.common.network.SslTransportLayer:339] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake NEED_WRAP channelId 2, appReadBuffer pos 0, netReadBuffer pos 0, netWriteBuffer pos 0
02.12.2021 17:25:47,591 TRACE [org.apache.kafka.common.network.SslTransportLayer:472] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake handshakeWrap 2
02.12.2021 17:25:47,591 TRACE [org.apache.kafka.common.network.SslTransportLayer:356] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake NEED_WRAP channelId 2, handshakeResult Status = OK HandshakeStatus = NEED_UNWRAP
02.12.2021 17:25:47,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 6 iterations.
02.12.2021 17:25:47,591 TRACE [org.apache.kafka.common.network.SslTransportLayer:365] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake NEED_UNWRAP channelId 2, appReadBuffer pos 0, netReadBuffer pos 0, netWriteBuffer pos 464
02.12.2021 17:25:47,592 TRACE [org.apache.kafka.common.network.SslTransportLayer:499] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap 2
02.12.2021 17:25:47,592 TRACE [org.apache.kafka.common.network.SslTransportLayer:519] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap: handshakeStatus NEED_UNWRAP status BUFFER_UNDERFLOW
02.12.2021 17:25:47,592 TRACE [org.apache.kafka.common.network.SslTransportLayer:387] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake NEED_UNWRAP channelId 2, handshakeResult Status = BUFFER_UNDERFLOW HandshakeStatus = NEED_UNWRAP
02.12.2021 17:25:47,627 TRACE [org.apache.kafka.common.network.SslTransportLayer:365] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake NEED_UNWRAP channelId 2, appReadBuffer pos 0, netReadBuffer pos 2230, netWriteBuffer pos 464
02.12.2021 17:25:47,627 TRACE [org.apache.kafka.common.network.SslTransportLayer:499] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap 2
02.12.2021 17:25:47,627 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:47,625 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 20
02.12.2021 17:25:47,624 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 286
02.12.2021 17:25:47,632 TRACE [org.apache.kafka.common.network.SslTransportLayer:519] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap: handshakeStatus NEED_WRAP status OK
02.12.2021 17:25:47,641 TRACE [org.apache.kafka.common.network.SslTransportLayer:387] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake NEED_UNWRAP channelId 2, handshakeResult Status = OK HandshakeStatus = NEED_TASK
02.12.2021 17:25:47,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 189
02.12.2021 17:25:47,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 5 records with 6 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,660 TRACE [org.apache.kafka.common.network.SslTransportLayer:339] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake NEED_WRAP channelId 2, appReadBuffer pos 0, netReadBuffer pos 0, netWriteBuffer pos 464
02.12.2021 17:25:47,660 TRACE [org.apache.kafka.common.network.SslTransportLayer:472] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake handshakeWrap 2
02.12.2021 17:25:47,660 TRACE [org.apache.kafka.common.network.SslTransportLayer:356] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake NEED_WRAP channelId 2, handshakeResult Status = OK HandshakeStatus = NEED_WRAP
02.12.2021 17:25:47,661 TRACE [org.apache.kafka.common.network.SslTransportLayer:339] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake NEED_WRAP channelId 2, appReadBuffer pos 0, netReadBuffer pos 0, netWriteBuffer pos 75
02.12.2021 17:25:47,661 TRACE [org.apache.kafka.common.network.SslTransportLayer:472] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake handshakeWrap 2
02.12.2021 17:25:47,661 TRACE [org.apache.kafka.common.network.SslTransportLayer:356] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake NEED_WRAP channelId 2, handshakeResult Status = OK HandshakeStatus = NEED_WRAP
02.12.2021 17:25:47,661 TRACE [org.apache.kafka.common.network.SslTransportLayer:339] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake NEED_WRAP channelId 2, appReadBuffer pos 0, netReadBuffer pos 0, netWriteBuffer pos 6
02.12.2021 17:25:47,661 TRACE [org.apache.kafka.common.network.SslTransportLayer:472] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake handshakeWrap 2
02.12.2021 17:25:47,661 TRACE [org.apache.kafka.common.network.SslTransportLayer:356] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake NEED_WRAP channelId 2, handshakeResult Status = OK HandshakeStatus = NEED_UNWRAP
02.12.2021 17:25:47,662 TRACE [org.apache.kafka.common.network.SslTransportLayer:365] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake NEED_UNWRAP channelId 2, appReadBuffer pos 0, netReadBuffer pos 0, netWriteBuffer pos 45
02.12.2021 17:25:47,662 TRACE [org.apache.kafka.common.network.SslTransportLayer:499] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap 2
02.12.2021 17:25:47,662 TRACE [org.apache.kafka.common.network.SslTransportLayer:519] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap: handshakeStatus NEED_UNWRAP status BUFFER_UNDERFLOW
02.12.2021 17:25:47,662 TRACE [org.apache.kafka.common.network.SslTransportLayer:387] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake NEED_UNWRAP channelId 2, handshakeResult Status = BUFFER_UNDERFLOW HandshakeStatus = NEED_UNWRAP
02.12.2021 17:25:47,662 TRACE [org.apache.kafka.common.network.SslTransportLayer:365] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake NEED_UNWRAP channelId 2, appReadBuffer pos 0, netReadBuffer pos 6, netWriteBuffer pos 45
02.12.2021 17:25:47,662 TRACE [org.apache.kafka.common.network.SslTransportLayer:499] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap 2
02.12.2021 17:25:47,662 TRACE [org.apache.kafka.common.network.SslTransportLayer:519] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap: handshakeStatus NEED_UNWRAP status OK
02.12.2021 17:25:47,662 TRACE [org.apache.kafka.common.network.SslTransportLayer:519] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap: handshakeStatus FINISHED status OK
02.12.2021 17:25:47,662 TRACE [org.apache.kafka.common.network.SslTransportLayer:387] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake NEED_UNWRAP channelId 2, handshakeResult Status = OK HandshakeStatus = FINISHED
02.12.2021 17:25:47,663 DEBUG [org.apache.kafka.common.network.SslTransportLayer:452] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSL handshake completed successfully with peerHost 'kafka-3.data.sta.par.eu.dc.sigfox.com' peerPort 9093 peerPrincipal 'CN=*.sigfox.com, O=SIGFOX S.A, L=Labege, C=FR' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384'
02.12.2021 17:25:47,663 TRACE [org.apache.kafka.common.network.SslTransportLayer:458] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@45d098c, interestOps=8, readyOps=0] SSLHandshake FINISHED channelId 2, appReadBuffer pos 0, netReadBuffer pos 0, netWriteBuffer pos 45 
02.12.2021 17:25:47,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:47,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 7 iterations.
02.12.2021 17:25:47,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 7 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:47,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:47,673 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=967846, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:47,673 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=967856, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:47,673 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:47,673 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-5, new queue size is 10
02.12.2021 17:25:47,673 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,673 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:47,673 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,673 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 7 iterations.
02.12.2021 17:25:47,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 512 ms and fetched 0 records
02.12.2021 17:25:47,676 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239683ms for 240000ms of delay, sleeping for 327ms
02.12.2021 17:25:47,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,679 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,682 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,685 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:47,682 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,702 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,702 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,702 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,702 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:47,700 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 191 and member id staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:47,706 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=66) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336,group_instance_id=null}
02.12.2021 17:25:47,735 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:47,739 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 172
02.12.2021 17:25:47,755 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 73
02.12.2021 17:25:47,802 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:47,816 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=66): org.apache.kafka.common.requests.HeartbeatResponse@548b199
02.12.2021 17:25:47,816 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:47,839 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 71
02.12.2021 17:25:47,838 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 88
02.12.2021 17:25:47,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 523 ms and fetched 0 records
02.12.2021 17:25:47,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,851 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,858 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,905 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:47,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:47,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,912 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,912 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 511 ms and fetched 0 records
02.12.2021 17:25:47,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,938 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,939 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,939 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:47,941 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59785ms for 60000ms of delay, sleeping for 225ms
02.12.2021 17:25:47,958 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:48,007 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238592ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:48,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:48,012 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:48,039 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:48,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:48,067 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:48,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,068 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,068 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:48,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:48,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,086 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,087 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:48,108 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:48,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:48,134 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119865ms delay out of 120000ms. Remaining 135ms. Executor queue at 0
02.12.2021 17:25:48,136 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 117753ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:48,139 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:48,159 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:48,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 10 records with 15 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 16 iterations.
02.12.2021 17:25:48,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 0 records with 16 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:48,168 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1140773, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:48,168 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1140783, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:48,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:48,168 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-3, new queue size is 10
02.12.2021 17:25:48,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,168 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:48,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 16 iterations.
02.12.2021 17:25:48,169 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59991ms for 60000ms of delay, sleeping for 19ms
02.12.2021 17:25:48,201 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59318ms for 60000ms of delay, sleeping for 692ms
02.12.2021 17:25:48,202 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:48,202 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,202 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,203 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:48,213 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:48,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:48,257 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:48,257 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:48,257 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=82) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8,group_instance_id=null}
02.12.2021 17:25:48,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:48,303 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:48,313 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:48,342 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:48,358 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=82): org.apache.kafka.common.requests.HeartbeatResponse@384dde5
02.12.2021 17:25:48,358 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:48,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:48,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,359 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,359 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 277
02.12.2021 17:25:48,403 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:48,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,413 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 209
02.12.2021 17:25:48,440 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,440 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,440 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,440 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,440 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,440 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,440 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,440 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,441 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:48,459 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 177
02.12.2021 17:25:48,503 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:48,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 109
02.12.2021 17:25:48,542 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:48,561 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 75
02.12.2021 17:25:48,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,569 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,569 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:48,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:48,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,587 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:48,604 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:48,613 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 9
02.12.2021 17:25:48,623 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,623 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:48,623 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:48,623 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=76) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21,group_instance_id=null}
02.12.2021 17:25:48,623 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,624 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=76): org.apache.kafka.common.requests.HeartbeatResponse@4543316a
02.12.2021 17:25:48,624 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:48,624 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 289
02.12.2021 17:25:48,625 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 288
02.12.2021 17:25:48,636 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,636 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,636 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,636 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,636 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,636 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,636 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,636 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,636 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,638 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:48,638 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:48,639 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=76) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b,group_instance_id=null}
02.12.2021 17:25:48,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 221
02.12.2021 17:25:48,639 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=76): org.apache.kafka.common.requests.HeartbeatResponse@6a93fa8f
02.12.2021 17:25:48,639 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:48,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 220
02.12.2021 17:25:48,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 220
02.12.2021 17:25:48,642 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:48,703 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:48,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,705 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,705 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:48,709 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:48,712 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:48,712 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=59) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d,group_instance_id=null}
02.12.2021 17:25:48,725 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 188
02.12.2021 17:25:48,739 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 120
02.12.2021 17:25:48,742 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:48,805 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:48,813 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=59): org.apache.kafka.common.requests.HeartbeatResponse@3711bbbc
02.12.2021 17:25:48,813 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:48,831 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 82
02.12.2021 17:25:48,840 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 19
02.12.2021 17:25:48,843 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:48,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:48,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,859 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,859 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:48,895 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58908ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:48,906 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:48,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:48,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,913 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,913 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:48,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,941 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,942 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:48,960 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:49,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:49,007 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239592ms delay out of 240000ms. Remaining 408ms. Executor queue at 0
02.12.2021 17:25:49,008 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238892ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:49,014 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:49,042 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:49,061 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:49,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,070 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,071 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:49,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,089 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,089 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:49,107 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:49,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:49,137 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 118754ms delay out of 120000ms. Remaining 1246ms. Executor queue at 1
02.12.2021 17:25:49,137 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 10 records with 36 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,137 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,137 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 110658ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:49,137 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:49,137 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 37 iterations.
02.12.2021 17:25:49,137 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 0 records with 37 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,137 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,137 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 110658ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:49,137 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:49,137 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:49,137 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:49,137 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:49,138 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:49,138 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 123, -60, 27, -87, -99, 46, 69, 70, -123, -109, 86, 85, 111, -45, 14, -12, 0, 0, 0, 0, 0, 0, 0, 0, 24, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 8])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:49,138 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=67) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:49,138 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1001803, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:49,138 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1001813, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:49,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:49,139 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] task [0_8] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-8, new queue size is 10
02.12.2021 17:25:49,139 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,139 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:49,139 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,139 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 37 iterations.
02.12.2021 17:25:49,139 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118677ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:49,142 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:49,161 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:49,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:49,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,206 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,206 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:49,214 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:49,226 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:49,242 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:49,262 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:49,306 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:49,315 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:49,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:49,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,362 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,363 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:49,407 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:49,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:49,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,413 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:49,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,443 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,443 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:49,463 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:49,507 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:49,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:49,543 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:49,564 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:49,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:49,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,571 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,572 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:49,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,595 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,595 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,595 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,595 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,595 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,595 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,595 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:49,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:49,614 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:49,644 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:49,664 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:49,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,707 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,708 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,708 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,708 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,708 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,708 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,718 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 478
02.12.2021 17:25:49,715 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:49,744 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:49,764 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:49,820 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 93
02.12.2021 17:25:49,819 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 377
02.12.2021 17:25:49,849 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:49,863 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,865 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,867 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:49,895 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59908ms delay out of 60000ms. Remaining 92ms. Executor queue at 1
02.12.2021 17:25:49,907 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59872ms for 60000ms of delay, sleeping for 138ms
02.12.2021 17:25:49,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,916 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,919 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,919 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,920 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:49,922 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 274
02.12.2021 17:25:49,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:49,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,950 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,951 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 324
02.12.2021 17:25:49,968 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:49,977 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=73): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', members=[])
02.12.2021 17:25:49,977 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=73): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', members=[])
02.12.2021 17:25:49,980 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', members=[])
02.12.2021 17:25:49,980 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:49,980 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=192, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', protocol='stream'}
02.12.2021 17:25:49,980 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', members=[])
02.12.2021 17:25:49,981 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:49,981 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=192, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=192, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:49,981 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=74) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf,group_instance_id=null,assignments=[]}
02.12.2021 17:25:49,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 114
02.12.2021 17:25:49,981 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=192, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', protocol='stream'}
02.12.2021 17:25:49,983 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=192, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=192, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:49,984 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=74) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82,group_instance_id=null,assignments=[]}
02.12.2021 17:25:49,984 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 88
02.12.2021 17:25:50,008 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239892ms delay out of 240000ms. Remaining 108ms. Executor queue at 1
02.12.2021 17:25:50,010 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239188ms for 240000ms of delay, sleeping for 822ms
02.12.2021 17:25:50,020 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:50,023 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 173
02.12.2021 17:25:50,051 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 223
02.12.2021 17:25:50,052 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59387ms for 60000ms of delay, sleeping for 623ms
02.12.2021 17:25:50,068 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:50,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:50,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,073 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,073 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:50,082 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=74): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,082 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,082 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=74): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,082 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=192, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', protocol='stream'}
02.12.2021 17:25:50,082 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,082 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=192, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', protocol='stream'}
02.12.2021 17:25:50,082 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 192 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82
02.12.2021 17:25:50,083 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:50,082 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 192 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf
02.12.2021 17:25:50,083 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:50,083 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:50,083 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:50,083 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:50,083 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:50,083 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:50,083 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:50,083 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:50,083 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:50,083 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4] State transition from RUNNING to REBALANCING
02.12.2021 17:25:50,083 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:50,083 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:50,083 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 13
02.12.2021 17:25:50,084 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 491
02.12.2021 17:25:50,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:50,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:50,098 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:50,099 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:50,099 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:50,099 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:50,099 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:50,099 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:50,099 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:50,099 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:50,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:50,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,099 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,099 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:50,120 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:50,123 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 73
02.12.2021 17:25:50,139 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119677ms delay out of 120000ms. Remaining 323ms. Executor queue at 1
02.12.2021 17:25:50,140 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119494ms for 120000ms of delay, sleeping for 516ms
02.12.2021 17:25:50,151 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 123
02.12.2021 17:25:50,168 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:50,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 389
02.12.2021 17:25:50,196 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,197 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:50,198 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:50,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,198 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=70) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42,group_instance_id=null}
02.12.2021 17:25:50,202 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 16
02.12.2021 17:25:50,203 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=70): org.apache.kafka.common.requests.HeartbeatResponse@4167d190
02.12.2021 17:25:50,203 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:50,203 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 15
02.12.2021 17:25:50,204 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 14
02.12.2021 17:25:50,202 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 397
02.12.2021 17:25:50,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:50,218 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 510 ms and fetched 0 records
02.12.2021 17:25:50,223 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,223 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,223 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,223 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,224 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:50,251 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 23
02.12.2021 17:25:50,269 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:50,275 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:50,276 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:50,276 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=70) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422,group_instance_id=null}
02.12.2021 17:25:50,275 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,277 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=70): org.apache.kafka.common.requests.HeartbeatResponse@10625f3b
02.12.2021 17:25:50,277 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:50,278 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 173
02.12.2021 17:25:50,278 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 172
02.12.2021 17:25:50,285 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 288
02.12.2021 17:25:50,304 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 295
02.12.2021 17:25:50,323 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:50,325 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:50,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:50,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,369 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,369 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:50,381 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 70
02.12.2021 17:25:50,385 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 188
02.12.2021 17:25:50,406 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 193
02.12.2021 17:25:50,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:50,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,421 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,422 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:50,425 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:50,451 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:50,451 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,451 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,451 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,451 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,451 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,451 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,451 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,452 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:50,470 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:50,486 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 87
02.12.2021 17:25:50,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 93
02.12.2021 17:25:50,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:50,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:50,552 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:50,570 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:50,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:50,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:50,573 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:50,573 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:50,573 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:50,574 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:50,574 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:50,574 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:50,574 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:50,574 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:50,574 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4] State transition from REBALANCING to RUNNING
02.12.2021 17:25:50,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:50,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,574 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,574 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:50,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:50,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,600 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,600 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:50,624 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:50,628 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:50,652 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:50,658 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119861ms for 120000ms of delay, sleeping for 149ms
02.12.2021 17:25:50,670 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:50,674 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:50,676 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59532ms for 60000ms of delay, sleeping for 478ms
02.12.2021 17:25:50,701 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:50,724 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:50,724 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:50,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,725 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,725 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:50,753 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:50,771 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:50,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:50,801 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:50,812 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119703ms for 120000ms of delay, sleeping for 307ms
02.12.2021 17:25:50,825 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:50,826 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:50,833 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239657ms for 240000ms of delay, sleeping for 353ms
02.12.2021 17:25:50,853 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:50,869 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:50,870 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,870 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,870 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,870 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,870 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,870 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,870 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,870 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:50,876 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:50,901 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:50,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:50,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,923 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:50,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:50,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:50,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,952 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,953 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:50,972 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 398
02.12.2021 17:25:50,976 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:51,002 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:51,025 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:51,026 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:51,053 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:51,072 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:51,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,075 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,075 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:51,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,100 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,101 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:51,122 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119995ms for 120000ms of delay, sleeping for 15ms
02.12.2021 17:25:51,125 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:51,127 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:51,139 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119681ms for 120000ms of delay, sleeping for 329ms
02.12.2021 17:25:51,153 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:51,155 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59245ms for 60000ms of delay, sleeping for 765ms
02.12.2021 17:25:51,173 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:51,175 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:51,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 7 records with 7 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 8 iterations.
02.12.2021 17:25:51,192 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239959ms for 240000ms of delay, sleeping for 51ms
02.12.2021 17:25:51,201 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:51,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,225 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:51,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:51,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 3 records with 8 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 9 iterations.
02.12.2021 17:25:51,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 9 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:51,246 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=967856, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:51,246 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=967866, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:51,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:51,246 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-5, new queue size is 10
02.12.2021 17:25:51,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,246 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:51,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 9 iterations.
02.12.2021 17:25:51,247 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239378ms for 240000ms of delay, sleeping for 632ms
02.12.2021 17:25:51,254 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:51,264 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:51,265 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:51,265 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=83) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8,group_instance_id=null}
02.12.2021 17:25:51,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:51,275 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:51,302 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:51,326 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:51,326 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:51,354 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:51,366 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=83): org.apache.kafka.common.requests.HeartbeatResponse@380a5407
02.12.2021 17:25:51,367 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:51,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,371 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,371 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 267
02.12.2021 17:25:51,376 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:51,403 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:51,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:51,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,425 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,425 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:51,426 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:51,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,455 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,456 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:51,469 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119192ms for 120000ms of delay, sleeping for 818ms
02.12.2021 17:25:51,472 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 166
02.12.2021 17:25:51,478 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:51,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:51,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:51,530 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:51,557 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:51,572 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 66
02.12.2021 17:25:51,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:51,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,582 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:51,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:51,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,604 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,604 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:51,623 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:51,623 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:51,624 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:51,625 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=77) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21,group_instance_id=null}
02.12.2021 17:25:51,625 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 302
02.12.2021 17:25:51,628 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=77): org.apache.kafka.common.requests.HeartbeatResponse@71955c0c
02.12.2021 17:25:51,628 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:51,628 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:51,628 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:51,630 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:51,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:51,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:51,638 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:51,639 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:51,639 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=77) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b,group_instance_id=null}
02.12.2021 17:25:51,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:51,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 232
02.12.2021 17:25:51,641 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=77): org.apache.kafka.common.requests.HeartbeatResponse@10a22332
02.12.2021 17:25:51,642 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:51,642 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 229
02.12.2021 17:25:51,643 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 228
02.12.2021 17:25:51,658 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:51,686 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 396
02.12.2021 17:25:51,705 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:51,725 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:51,726 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:51,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:51,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,727 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,727 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=60) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d,group_instance_id=null}
02.12.2021 17:25:51,729 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:51,728 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:51,743 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 128
02.12.2021 17:25:51,758 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:51,790 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 292
02.12.2021 17:25:51,807 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:51,829 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=60): org.apache.kafka.common.requests.HeartbeatResponse@39d6532e
02.12.2021 17:25:51,830 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:51,831 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 94
02.12.2021 17:25:51,831 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:51,843 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 28
02.12.2021 17:25:51,858 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:51,872 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:51,872 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,879 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,879 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:51,882 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239867ms for 240000ms of delay, sleeping for 143ms
02.12.2021 17:25:51,893 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 189
02.12.2021 17:25:51,907 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:51,923 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 57744ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:51,928 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:51,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,931 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,932 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,932 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,932 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,932 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,932 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:51,934 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:51,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:51,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,957 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,957 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:51,979 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:51,995 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 87
02.12.2021 17:25:52,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:52,028 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239857ms for 240000ms of delay, sleeping for 153ms
02.12.2021 17:25:52,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:52,035 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:52,057 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:52,080 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:52,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:52,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,082 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,083 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:52,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:52,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,104 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,105 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:52,133 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:52,135 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:52,158 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:52,183 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:52,180 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:52,198 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239849ms for 240000ms of delay, sleeping for 161ms
02.12.2021 17:25:52,205 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:52,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:52,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,229 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:52,233 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:52,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:52,285 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:52,285 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 94
02.12.2021 17:25:52,289 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119177ms for 120000ms of delay, sleeping for 833ms
02.12.2021 17:25:52,307 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:52,332 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:52,334 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:52,358 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:52,363 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239472ms for 240000ms of delay, sleeping for 538ms
02.12.2021 17:25:52,380 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,380 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,380 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,381 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:52,385 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:52,407 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:52,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:52,433 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:52,433 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,433 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,433 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,434 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,434 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,434 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,434 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,434 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:52,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,458 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,458 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:52,481 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:52,486 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:52,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:52,534 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:52,534 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:52,559 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:52,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:52,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:52,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,583 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 398
02.12.2021 17:25:52,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,605 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,607 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,607 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,607 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 373
02.12.2021 17:25:52,634 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:52,635 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:52,659 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:52,682 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:52,683 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:52,707 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 273
02.12.2021 17:25:52,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,733 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,733 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,733 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,733 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,734 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,734 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,738 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:52,738 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 459
02.12.2021 17:25:52,759 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:52,784 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:52,784 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:52,811 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 169
02.12.2021 17:25:52,840 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 357
02.12.2021 17:25:52,840 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 94
02.12.2021 17:25:52,861 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:52,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:52,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,883 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,883 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:52,886 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:52,903 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239961ms for 240000ms of delay, sleeping for 49ms
02.12.2021 17:25:52,913 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 67
02.12.2021 17:25:52,925 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 58746ms delay out of 60000ms. Remaining 1254ms. Executor queue at 0
02.12.2021 17:25:52,925 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58662ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:52,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,935 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,935 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:52,941 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 257
02.12.2021 17:25:52,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 9 records with 9 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 10 iterations.
02.12.2021 17:25:52,953 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239968ms for 240000ms of delay, sleeping for 42ms
02.12.2021 17:25:52,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:52,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,958 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,959 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 316
02.12.2021 17:25:52,980 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,980 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,980 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,980 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,980 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,980 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,980 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,980 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,982 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,982 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,982 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,982 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,982 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,982 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:52,982 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 192 and member id staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:52,982 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:52,982 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=75) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf,group_instance_id=null}
02.12.2021 17:25:52,982 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:52,982 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 192 and member id staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:52,982 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 125
02.12.2021 17:25:52,982 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=75) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82,group_instance_id=null}
02.12.2021 17:25:52,982 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=75): org.apache.kafka.common.requests.HeartbeatResponse@241dedc9
02.12.2021 17:25:52,983 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 101
02.12.2021 17:25:52,983 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:52,983 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=75): org.apache.kafka.common.requests.HeartbeatResponse@46e54242
02.12.2021 17:25:52,983 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 192 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf
02.12.2021 17:25:52,983 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:52,983 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:52,983 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 192 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82
02.12.2021 17:25:52,983 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:52,983 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:52,983 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:52,983 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 123, -60, 27, -87, -99, 46, 69, 70, -123, -109, 86, 85, 111, -45, 14, -12, 0, 0, 0, 0, 0, 0, 0, 0, 25, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:52,983 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 123, -60, 27, -87, -99, 46, 69, 70, -123, -109, 86, 85, 111, -45, 14, -12, 0, 0, 0, 0, 0, 0, 0, 0, 25, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:52,983 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=76) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:52,983 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=76) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:52,984 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:52,984 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 123
02.12.2021 17:25:52,984 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:52,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 1 records with 10 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 11 iterations.
02.12.2021 17:25:52,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 11 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:52,996 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=967866, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:52,996 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=967876, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:52,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:52,997 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-5, new queue size is 10
02.12.2021 17:25:52,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,997 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:52,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 11 iterations.
02.12.2021 17:25:52,997 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239957ms for 240000ms of delay, sleeping for 53ms
02.12.2021 17:25:53,035 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:53,041 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 156
02.12.2021 17:25:53,052 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238850ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:53,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 216
02.12.2021 17:25:53,082 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:53,083 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:53,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:53,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,083 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,083 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:53,084 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:53,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:53,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,107 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,108 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:53,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 10 records with 37 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:53,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 114644ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:53,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:53,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 38 iterations.
02.12.2021 17:25:53,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 0 records with 38 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:53,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 114644ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:53,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:53,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:53,124 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=67): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', members=[])
02.12.2021 17:25:53,124 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', members=[])
02.12.2021 17:25:53,124 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:53,124 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=192, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', protocol='stream'}
02.12.2021 17:25:53,124 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=192, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=192, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:53,124 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1001813, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:53,125 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=68) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336,group_instance_id=null,assignments=[]}
02.12.2021 17:25:53,125 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1001823, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:53,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:53,125 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] task [0_8] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-8, new queue size is 10
02.12.2021 17:25:53,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,125 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:53,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 38 iterations.
02.12.2021 17:25:53,127 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119935ms for 120000ms of delay, sleeping for 75ms
02.12.2021 17:25:53,136 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:53,141 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 56
02.12.2021 17:25:53,160 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 115
02.12.2021 17:25:53,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:53,197 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:53,197 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:53,198 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=71) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42,group_instance_id=null}
02.12.2021 17:25:53,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,199 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=71): org.apache.kafka.common.requests.HeartbeatResponse@553893f2
02.12.2021 17:25:53,199 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:53,199 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 39
02.12.2021 17:25:53,199 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 39
02.12.2021 17:25:53,206 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119764ms for 120000ms of delay, sleeping for 246ms
02.12.2021 17:25:53,225 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=68): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:53,226 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=192, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', protocol='stream'}
02.12.2021 17:25:53,236 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:53,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:53,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,239 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:53,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 15
02.12.2021 17:25:53,276 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:53,276 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,277 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:53,277 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=71) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422,group_instance_id=null}
02.12.2021 17:25:53,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 182
02.12.2021 17:25:53,279 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=71): org.apache.kafka.common.requests.HeartbeatResponse@495981af
02.12.2021 17:25:53,279 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:53,279 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 180
02.12.2021 17:25:53,279 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 180
02.12.2021 17:25:53,286 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:53,336 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:53,339 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:53,379 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 80
02.12.2021 17:25:53,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:53,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,383 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,384 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:53,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,436 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,436 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:53,440 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:53,453 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119416ms for 120000ms of delay, sleeping for 594ms
02.12.2021 17:25:53,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,460 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,460 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:53,484 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:53,540 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:53,542 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 398
02.12.2021 17:25:53,560 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:53,584 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,584 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,584 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,584 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,584 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,584 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,584 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,584 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,584 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:53,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:53,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:53,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,612 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,612 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:53,649 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:53,654 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 282
02.12.2021 17:25:53,661 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:53,691 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 193
02.12.2021 17:25:53,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:53,743 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,743 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,743 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,743 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,743 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,743 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,744 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:53,754 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 182
02.12.2021 17:25:53,762 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:53,802 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 83
02.12.2021 17:25:53,844 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:53,855 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 81
02.12.2021 17:25:53,862 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:53,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,886 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,887 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,887 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,887 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,887 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,887 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,887 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:53,926 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59663ms delay out of 60000ms. Remaining 337ms. Executor queue at 1
02.12.2021 17:25:53,926 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 10 records with 16 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,926 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:53,926 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Committing all active tasks [0_3] and standby tasks [] since 30568ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:53,926 DEBUG [org.apache.kafka.streams.processor.internals.RecordCollectorImpl:247] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] task [0_3] Flushing record collector
02.12.2021 17:25:53,926 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:381] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] task [0_3] Prepared RUNNING task for committing
02.12.2021 17:25:53,926 TRACE [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1157] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending OffsetCommit request with {redacted.Cloud.Message.Callback.Retry1-3=OffsetAndMetadata{offset=1140783, leaderEpoch=null, metadata='AQAAAX179oj3'}} to coordinator kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:53,927 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending OFFSET_COMMIT request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=84) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8,group_instance_id=null,topics=[{name=redacted.Cloud.Message.Callback.Retry1,partitions=[{partition_index=3,committed_offset=1140783,committed_leader_epoch=-1,committed_metadata=AQAAAX179oj3}]}]}
02.12.2021 17:25:53,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,937 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,937 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:53,944 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:53,948 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received OFFSET_COMMIT response from node 2147483644 for request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=84): OffsetCommitResponseData(throttleTimeMs=0, topics=[OffsetCommitResponseTopic(name='redacted.Cloud.Message.Callback.Retry1', partitions=[OffsetCommitResponsePartition(partitionIndex=3, errorCode=0)])])
02.12.2021 17:25:53,948 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1185] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Committed offset 1140783 for partition redacted.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:53,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:808] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] task [0_3] Checkpointable offsets {redacted.Cloud.Message.Callback.Retry1-3=1140782}
02.12.2021 17:25:53,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:465] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] task [0_3] Finalized commit for RUNNING task with eos false enforce checkpoint false
02.12.2021 17:25:53,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:684] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Committed all active tasks [0_3] and standby tasks [] in 0ms
02.12.2021 17:25:53,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 8 iterations.
02.12.2021 17:25:53,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 0 records with 8 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:53,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:53,949 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1140783, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:53,949 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1140793, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:53,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:53,949 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-3, new queue size is 10
02.12.2021 17:25:53,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,949 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:53,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 8 iterations.
02.12.2021 17:25:53,949 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59546ms for 60000ms of delay, sleeping for 464ms
02.12.2021 17:25:53,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,962 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,962 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,962 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,962 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,962 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,962 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,962 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,962 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:53,988 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:54,037 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:54,045 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:54,049 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119692ms for 120000ms of delay, sleeping for 318ms
02.12.2021 17:25:54,052 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239851ms delay out of 240000ms. Remaining 149ms. Executor queue at 2
02.12.2021 17:25:54,052 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239272ms for 240000ms of delay, sleeping for 738ms
02.12.2021 17:25:54,062 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:54,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,085 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,085 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:54,088 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:54,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:54,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,113 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:54,138 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:54,145 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:54,162 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:54,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:54,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:54,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:54,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,244 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:54,263 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:54,281 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:54,281 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:54,281 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=85) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8,group_instance_id=null}
02.12.2021 17:25:54,289 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:54,340 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:54,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:54,363 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:54,368 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118599ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:54,382 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=85): org.apache.kafka.common.requests.HeartbeatResponse@2c151276
02.12.2021 17:25:54,382 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:54,387 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:54,387 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,387 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,387 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,387 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,387 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,388 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 250
02.12.2021 17:25:54,416 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59642ms for 60000ms of delay, sleeping for 368ms
02.12.2021 17:25:54,437 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:54,437 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,438 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,438 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 185
02.12.2021 17:25:54,446 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:54,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:54,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,462 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,463 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:54,488 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 150
02.12.2021 17:25:54,539 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 84
02.12.2021 17:25:54,546 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:54,563 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:54,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,586 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:54,589 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 49
02.12.2021 17:25:54,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,614 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,614 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:54,623 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,623 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,623 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,623 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,623 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,623 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,623 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,623 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,623 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,623 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,624 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,624 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,624 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,624 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:54,624 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:54,624 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=78) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21,group_instance_id=null}
02.12.2021 17:25:54,624 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 314
02.12.2021 17:25:54,625 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=78): org.apache.kafka.common.requests.HeartbeatResponse@db6b507
02.12.2021 17:25:54,626 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:54,626 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 312
02.12.2021 17:25:54,627 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 311
02.12.2021 17:25:54,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,640 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:54,640 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:54,640 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=78) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b,group_instance_id=null}
02.12.2021 17:25:54,641 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 248
02.12.2021 17:25:54,641 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=78): org.apache.kafka.common.requests.HeartbeatResponse@37c10c29
02.12.2021 17:25:54,641 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:54,641 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 247
02.12.2021 17:25:54,641 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 247
02.12.2021 17:25:54,647 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:54,664 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:54,727 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 211
02.12.2021 17:25:54,738 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:54,738 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:54,738 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=61) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d,group_instance_id=null}
02.12.2021 17:25:54,742 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 146
02.12.2021 17:25:54,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:54,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,748 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,748 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:54,765 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:54,788 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59961ms for 60000ms of delay, sleeping for 49ms
02.12.2021 17:25:54,799 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239835ms for 240000ms of delay, sleeping for 175ms
02.12.2021 17:25:54,830 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 108
02.12.2021 17:25:54,840 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59731ms for 60000ms of delay, sleeping for 279ms
02.12.2021 17:25:54,838 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=61): org.apache.kafka.common.requests.HeartbeatResponse@3de9d0cc
02.12.2021 17:25:54,843 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:54,843 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 45
02.12.2021 17:25:54,848 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:54,865 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:54,888 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:54,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,889 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,889 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:54,932 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 7
02.12.2021 17:25:54,939 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,939 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,939 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,939 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,939 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,939 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,939 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,939 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,939 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:54,949 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:54,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,964 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,964 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:54,976 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239811ms for 240000ms of delay, sleeping for 199ms
02.12.2021 17:25:54,989 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:55,039 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:55,049 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:55,064 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:55,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,088 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,088 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:55,089 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:55,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:55,115 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,115 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,115 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,115 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,115 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,115 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,115 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,115 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:55,124 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59078ms for 60000ms of delay, sleeping for 932ms
02.12.2021 17:25:55,140 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:55,149 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:55,165 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:55,176 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239964ms for 240000ms of delay, sleeping for 46ms
02.12.2021 17:25:55,190 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:55,224 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239042ms for 240000ms of delay, sleeping for 968ms
02.12.2021 17:25:55,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:55,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:55,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,248 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,249 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,249 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,249 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,249 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,249 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:55,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:55,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:55,340 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:55,349 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:55,365 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:55,369 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119600ms delay out of 120000ms. Remaining 400ms. Executor queue at 0
02.12.2021 17:25:55,370 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119581ms for 120000ms of delay, sleeping for 429ms
02.12.2021 17:25:55,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:55,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,389 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,390 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,390 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,390 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:55,440 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,440 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,440 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,442 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,442 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:55,450 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:55,465 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,465 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,465 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,465 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,465 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,465 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,465 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,465 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:55,490 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:55,542 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:55,550 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:55,566 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:55,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,589 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:55,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:55,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:55,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,618 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,619 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:55,643 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:55,651 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:55,668 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:55,692 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:55,745 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:55,750 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,752 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,755 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 442
02.12.2021 17:25:55,770 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:55,798 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 92
02.12.2021 17:25:55,811 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119924ms for 120000ms of delay, sleeping for 86ms
02.12.2021 17:25:55,846 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:55,856 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 341
02.12.2021 17:25:55,870 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:55,894 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:55,894 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,894 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,894 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,898 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:55,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 10 records with 38 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:55,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 117424ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:55,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:55,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 39 iterations.
02.12.2021 17:25:55,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 0 records with 39 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:55,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 117426ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:55,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:55,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:55,905 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:55,906 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:55,907 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:55,909 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 123, -60, 27, -87, -99, 46, 69, 70, -123, -109, 86, 85, 111, -45, 14, -12, 0, 0, 0, 0, 0, 0, 0, 0, 25, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 8])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:55,910 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=69) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer-fe266161-af09-47a3-952a-f2d90c33f336,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:55,912 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name topic.redacted.Cloud.Message.Callback.Retry2.bytes-fetched
02.12.2021 17:25:55,912 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=fetch-size-avg, group=consumer-fetch-manager-metrics, description=The average number of bytes fetched per request for a topic, tags={client-id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry2}]
02.12.2021 17:25:55,912 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=fetch-size-max, group=consumer-fetch-manager-metrics, description=The maximum number of bytes fetched per request for a topic, tags={client-id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry2}]
02.12.2021 17:25:55,913 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=bytes-consumed-total, group=consumer-fetch-manager-metrics, description=The total number of bytes consumed for a topic, tags={client-id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry2}]
02.12.2021 17:25:55,913 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=bytes-consumed-rate, group=consumer-fetch-manager-metrics, description=The average number of bytes consumed per second for a topic, tags={client-id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry2}]
02.12.2021 17:25:55,913 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name topic.redacted.Cloud.Message.Callback.Retry2.records-fetched
02.12.2021 17:25:55,913 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=records-per-request-avg, group=consumer-fetch-manager-metrics, description=The average number of records in each request for a topic, tags={client-id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry2}]
02.12.2021 17:25:55,913 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=records-consumed-total, group=consumer-fetch-manager-metrics, description=The total number of records consumed for a topic, tags={client-id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry2}]
02.12.2021 17:25:55,913 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=records-consumed-rate, group=consumer-fetch-manager-metrics, description=The average number of records consumed per second for a topic, tags={client-id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry2}]
02.12.2021 17:25:55,913 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 6 fetched records at offset FetchPosition{offset=1001823, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:55,913 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1001829, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:55,913 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:1199] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Added READ_UNCOMMITTED fetch request for partition redacted.Cloud.Message.Callback.Retry2-8 at position FetchPosition{offset=1001829, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.par.eu.dc.sigfox.com:9093 (id: 4 rack: null)], epoch=absent}} to node kafka-5.data.sta.par.eu.dc.sigfox.com:9093 (id: 4 rack: null)
02.12.2021 17:25:55,913 DEBUG [org.apache.kafka.clients.FetchSessionHandler:259] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Built incremental fetch (sessionId=1061931867, epoch=1) for node 4. Added (), altered (redacted.Cloud.Message.Callback.Retry2-8), removed () out of (OSS.STAGING.Cloud.Message.Callback.Retry2-8)
02.12.2021 17:25:55,913 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:266] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(redacted.Cloud.Message.Callback.Retry2-8), toForget=(), implied=()) to broker kafka-5.data.sta.par.eu.dc.sigfox.com:9093 (id: 4 rack: null)
02.12.2021 17:25:55,913 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending FETCH request with header RequestHeader(apiKey=FETCH, apiVersion=11, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=70) and timeout 30000 to node 4: {replica_id=-1,max_wait_ms=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=1061931867,session_epoch=1,topics=[{topic=redacted.Cloud.Message.Callback.Retry2,partitions=[{partition=8,current_leader_epoch=-1,fetch_offset=1001829,log_start_offset=-1,partition_max_bytes=1048576}]}],forgotten_topics_data=[],rack_id=}
02.12.2021 17:25:55,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Main Consumer poll completed in 8 ms and fetched 6 records
02.12.2021 17:25:55,914 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] task [0_8] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-8, new queue size is 6
02.12.2021 17:25:55,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,914 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:55,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 39 iterations.
02.12.2021 17:25:55,928 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119130ms for 120000ms of delay, sleeping for 880ms
02.12.2021 17:25:55,934 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:55,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:55,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,942 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,943 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:55,967 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 230
02.12.2021 17:25:55,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:55,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,970 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,970 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 306
02.12.2021 17:25:55,999 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:56,044 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:56,058 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59225ms for 60000ms of delay, sleeping for 785ms
02.12.2021 17:25:56,068 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 129
02.12.2021 17:25:56,070 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 206
02.12.2021 17:25:56,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,091 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,091 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:56,099 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:56,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,119 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,119 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,119 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:56,144 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:56,168 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 29
02.12.2021 17:25:56,171 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 105
02.12.2021 17:25:56,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,198 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,198 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,198 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,198 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,198 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,198 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:56,200 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:56,200 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=72) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42,group_instance_id=null}
02.12.2021 17:25:56,200 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:56,200 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 57
02.12.2021 17:25:56,201 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=72): org.apache.kafka.common.requests.HeartbeatResponse@58b8eec7
02.12.2021 17:25:56,203 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:56,203 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 52
02.12.2021 17:25:56,203 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 52
02.12.2021 17:25:56,206 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239497ms for 240000ms of delay, sleeping for 513ms
02.12.2021 17:25:56,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:56,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:56,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,255 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,255 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:56,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 4
02.12.2021 17:25:56,276 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:56,276 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:56,276 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,276 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=72) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422,group_instance_id=null}
02.12.2021 17:25:56,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:56,277 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=72): org.apache.kafka.common.requests.HeartbeatResponse@748e0f6c
02.12.2021 17:25:56,277 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:56,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:56,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:56,301 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:56,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:56,356 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:56,377 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:56,399 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,399 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,399 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,399 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,399 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,399 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,399 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,399 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,399 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:56,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:56,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,444 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,444 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:56,456 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:56,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,471 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,471 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:56,499 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:56,544 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:56,557 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:56,572 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:56,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,592 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:56,601 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:56,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,620 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,620 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:56,644 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:56,659 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:56,673 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:56,701 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:56,722 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 10 records with 11 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,722 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:56,722 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 12 iterations.
02.12.2021 17:25:56,722 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processed 0 records with 12 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,722 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:56,722 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:56,722 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=967876, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:56,724 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=967886, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:56,724 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:56,724 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-5, new queue size is 10
02.12.2021 17:25:56,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,725 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:56,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1] Processing tasks with 12 iterations.
02.12.2021 17:25:56,726 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239788ms for 240000ms of delay, sleeping for 222ms
02.12.2021 17:25:56,745 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:56,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,759 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,759 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,759 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,759 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,760 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:56,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:56,802 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:56,812 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119732ms for 120000ms of delay, sleeping for 278ms
02.12.2021 17:25:56,845 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59944ms for 60000ms of delay, sleeping for 66ms
02.12.2021 17:25:56,845 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:56,860 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:56,874 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:56,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:56,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,899 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,900 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:56,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 8 records with 8 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:56,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 9 iterations.
02.12.2021 17:25:56,912 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59377ms for 60000ms of delay, sleeping for 633ms
02.12.2021 17:25:56,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:56,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,945 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,945 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:56,950 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239769ms for 240000ms of delay, sleeping for 241ms
02.12.2021 17:25:56,961 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:56,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,972 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,972 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:57,000 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:57,045 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:57,061 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:57,073 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:57,092 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119760ms for 120000ms of delay, sleeping for 250ms
02.12.2021 17:25:57,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,093 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,093 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:57,100 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:57,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,121 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,121 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:57,145 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:57,161 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:57,173 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:57,199 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238320ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:57,200 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 200
02.12.2021 17:25:57,246 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:57,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,261 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:57,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:57,286 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:57,287 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:57,287 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=86) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer-a25e2afc-7777-41e5-8b57-2c95762129c8,group_instance_id=null}
02.12.2021 17:25:57,301 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:57,343 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119332ms for 120000ms of delay, sleeping for 678ms
02.12.2021 17:25:57,346 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:57,361 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:57,374 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:57,387 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, correlationId=86): org.apache.kafka.common.requests.HeartbeatResponse@13f74b9
02.12.2021 17:25:57,387 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:57,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:57,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,400 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,401 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 239
02.12.2021 17:25:57,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,447 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,447 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 177
02.12.2021 17:25:57,462 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:57,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:57,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,472 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,472 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:57,501 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 139
02.12.2021 17:25:57,547 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59807ms for 60000ms of delay, sleeping for 203ms
02.12.2021 17:25:57,547 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 77
02.12.2021 17:25:57,563 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:57,572 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:57,594 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,595 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,595 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,595 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,595 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,595 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,595 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,595 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,599 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:57,602 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 38
02.12.2021 17:25:57,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,623 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,623 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,623 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,623 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,623 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,623 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,623 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,627 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:57,630 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:57,637 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:57,637 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=79) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer-630bc01b-e4b6-4c91-b7a5-b7d21f0c6b21,group_instance_id=null}
02.12.2021 17:25:57,630 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:57,638 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, correlationId=79): org.apache.kafka.common.requests.HeartbeatResponse@1d7b6bd
02.12.2021 17:25:57,642 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:57,643 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:57,642 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:57,638 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:57,644 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 309
02.12.2021 17:25:57,643 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=79) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer-b91c36b8-6904-4a23-8ea2-f0f96ff0557b,group_instance_id=null}
02.12.2021 17:25:57,647 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, correlationId=79): org.apache.kafka.common.requests.HeartbeatResponse@2b0014f7
02.12.2021 17:25:57,648 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:57,649 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 253
02.12.2021 17:25:57,649 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 252
02.12.2021 17:25:57,646 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 301
02.12.2021 17:25:57,663 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:57,673 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:57,749 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 152
02.12.2021 17:25:57,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 2 records with 9 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,754 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:57,756 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:57,756 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=62) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer-df0ca142-7c5f-42df-a2fa-3a7c6d6ad58d,group_instance_id=null}
02.12.2021 17:25:57,749 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:57,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,763 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,763 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:57,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:57,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 10 iterations.
02.12.2021 17:25:57,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processed 0 records with 10 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:57,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:57,766 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1140793, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:57,766 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1140803, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-3
02.12.2021 17:25:57,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:57,768 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] task [0_3] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-3, new queue size is 10
02.12.2021 17:25:57,768 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,768 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:57,768 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,768 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-1] Processing tasks with 10 iterations.
02.12.2021 17:25:57,778 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:57,786 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59731ms for 60000ms of delay, sleeping for 279ms
02.12.2021 17:25:57,849 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 52
02.12.2021 17:25:57,857 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 90
02.12.2021 17:25:57,857 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, correlationId=62): org.apache.kafka.common.requests.HeartbeatResponse@78eb5915
02.12.2021 17:25:57,866 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:57,865 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:57,884 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 88
02.12.2021 17:25:57,901 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:57,901 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,901 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,901 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,901 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,901 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,901 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,901 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,902 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:57,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:57,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,956 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,957 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:57,973 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 290
02.12.2021 17:25:57,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:57,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,974 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,976 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:58,004 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:58,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 6 records with 39 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:58,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 119544ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:58,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:58,024 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 40 iterations.
02.12.2021 17:25:58,024 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processed 0 records with 40 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,024 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:58,024 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Committing all active tasks [0_8] and standby tasks [] since 119545ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:58,024 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:58,024 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:58,025 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry2-8 because previous request to kafka-5.data.sta.par.eu.dc.sigfox.com:9093 (id: 4 rack: null) has not been processed
02.12.2021 17:25:58,025 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 499
02.12.2021 17:25:58,026 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received FETCH response from node 4 for request with header RequestHeader(apiKey=FETCH, apiVersion=11, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, correlationId=70): org.apache.kafka.common.requests.FetchResponse@411b1a1f
02.12.2021 17:25:58,026 DEBUG [org.apache.kafka.clients.FetchSessionHandler:463] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Node 4 sent an incremental fetch response with throttleTimeMs = 0 for session 1061931867 with response=(redacted.Cloud.Message.Callback.Retry2-8)
02.12.2021 17:25:58,026 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:315] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Fetch READ_UNCOMMITTED at offset 1001829 for partition redacted.Cloud.Message.Callback.Retry2-8 returned fetch data (error=NONE, highWaterMark=1002151, lastStableOffset = 1002151, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, divergingEpoch =Optional.empty, recordsSizeInBytes=144980)
02.12.2021 17:25:58,026 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1251] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Preparing to read 144980 bytes of data for partition redacted.Cloud.Message.Callback.Retry2-8 with offset FetchPosition{offset=1001829, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.par.eu.dc.sigfox.com:9093 (id: 4 rack: null)], epoch=absent}}
02.12.2021 17:25:58,026 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1275] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Updating high watermark for partition redacted.Cloud.Message.Callback.Retry2-8 to 1002151
02.12.2021 17:25:58,026 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1280] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Updating log start offset for partition redacted.Cloud.Message.Callback.Retry2-8 to 0
02.12.2021 17:25:58,026 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1285] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Updating last stable offset for partition redacted.Cloud.Message.Callback.Retry2-8 to 1002151
02.12.2021 17:25:58,026 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1001829, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:58,026 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1001839, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-8
02.12.2021 17:25:58,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Main Consumer poll completed in 3 ms and fetched 10 records
02.12.2021 17:25:58,027 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] task [0_8] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-8, new queue size is 10
02.12.2021 17:25:58,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,027 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:58,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-1] Processing tasks with 40 iterations.
02.12.2021 17:25:58,028 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119172ms for 120000ms of delay, sleeping for 838ms
02.12.2021 17:25:58,057 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:58,072 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59960ms for 60000ms of delay, sleeping for 50ms
02.12.2021 17:25:58,074 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:58,076 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:58,103 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:58,103 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,103 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,103 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,103 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,103 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,103 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,103 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,104 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:58,104 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:58,123 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59996ms for 60000ms of delay, sleeping for 14ms
02.12.2021 17:25:58,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:58,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,128 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,128 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:58,139 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59934ms for 60000ms of delay, sleeping for 76ms
02.12.2021 17:25:58,157 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:58,174 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:58,177 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:58,199 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239320ms delay out of 240000ms. Remaining 680ms. Executor queue at 0
02.12.2021 17:25:58,204 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:58,206 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239208ms for 240000ms of delay, sleeping for 802ms
02.12.2021 17:25:58,217 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59658ms for 60000ms of delay, sleeping for 352ms
02.12.2021 17:25:58,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:58,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:58,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,263 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,263 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:58,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:58,305 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:58,359 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:58,364 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:58,377 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:58,402 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,402 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,402 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,402 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,402 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,402 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,402 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,402 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,402 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:58,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:58,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,458 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,458 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:58,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:58,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,477 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,477 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:58,503 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:58,559 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:58,566 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:58,570 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59612ms for 60000ms of delay, sleeping for 398ms
02.12.2021 17:25:58,578 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:58,603 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:58,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,604 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,605 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:58,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,629 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,629 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:58,660 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:58,666 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:58,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 293
02.12.2021 17:25:58,703 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:58,760 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:58,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:58,764 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,766 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,768 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,769 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,771 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 427
02.12.2021 17:25:58,785 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:58,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 93
02.12.2021 17:25:58,861 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:58,867 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119911ms for 120000ms of delay, sleeping for 99ms
02.12.2021 17:25:58,872 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 326
02.12.2021 17:25:58,885 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:58,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:58,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,902 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,902 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:58,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:58,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,958 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,959 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:58,969 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119979ms for 120000ms of delay, sleeping for 31ms
02.12.2021 17:25:58,969 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59930ms for 60000ms of delay, sleeping for 80ms
02.12.2021 17:25:58,972 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 226
02.12.2021 17:25:58,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,978 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,978 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:59,002 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119556ms for 120000ms of delay, sleeping for 454ms
02.12.2021 17:25:59,003 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:59,012 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239699ms for 240000ms of delay, sleeping for 311ms
02.12.2021 17:25:59,051 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59034ms for 60000ms of delay, sleeping for 976ms
02.12.2021 17:25:59,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:59,072 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 126
02.12.2021 17:25:59,079 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:59,103 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:59,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,106 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,106 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:59,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,130 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,131 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:59,159 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:59,173 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 25
02.12.2021 17:25:59,179 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:59,198 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:59,201 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:59,201 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=73) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer-270cb347-27fe-4438-bdb2-1fc1cf982e42,group_instance_id=null}
02.12.2021 17:25:59,198 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,201 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 70
02.12.2021 17:25:59,203 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=76): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=193, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', members=[])
02.12.2021 17:25:59,203 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:59,203 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=193, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', members=[])
02.12.2021 17:25:59,204 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:59,203 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, correlationId=73): org.apache.kafka.common.requests.HeartbeatResponse@65da79be
02.12.2021 17:25:59,203 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=76): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=193, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', members=[])
02.12.2021 17:25:59,204 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:59,204 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=193, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', protocol='stream'}
02.12.2021 17:25:59,204 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=193, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=193, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:59,204 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 67
02.12.2021 17:25:59,204 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=193, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', members=[])
02.12.2021 17:25:59,205 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:59,205 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=193, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', protocol='stream'}
02.12.2021 17:25:59,205 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 66
02.12.2021 17:25:59,205 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=77) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=193,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82,group_instance_id=null,assignments=[]}
02.12.2021 17:25:59,205 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=193, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=193, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:59,206 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=77) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=193,member_id=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf,group_instance_id=null,assignments=[]}
02.12.2021 17:25:59,206 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 401
02.12.2021 17:25:59,206 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 425
02.12.2021 17:25:59,235 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, correlationId=77): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:59,235 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, correlationId=77): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:59,235 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:59,235 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:59,235 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=193, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82', protocol='stream'}
02.12.2021 17:25:59,235 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=193, memberId='staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf', protocol='stream'}
02.12.2021 17:25:59,236 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 193 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer-3b941dd0-1bc6-4e8e-b050-e0d0ddc76d82
02.12.2021 17:25:59,236 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 193 and memberId staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer-74936464-9c6d-4ebf-9c2a-7b561f295fcf
02.12.2021 17:25:59,236 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:59,236 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:59,236 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:59,236 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:59,236 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:59,236 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:59,236 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:59,236 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:59,236 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:59,236 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:59,236 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4] State transition from RUNNING to REBALANCING
02.12.2021 17:25:59,236 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:59,236 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:59,236 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 371
02.12.2021 17:25:59,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 396
02.12.2021 17:25:59,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:59,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:59,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,272 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:59,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,278 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,278 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,278 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,278 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,278 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:59,278 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:59,278 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=73) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer-570df1e7-882b-47e0-b617-390a3093f422,group_instance_id=null}
02.12.2021 17:25:59,279 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:59,279 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, correlationId=73): org.apache.kafka.common.requests.HeartbeatResponse@6ab54e73
02.12.2021 17:25:59,279 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:59,279 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:59,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:59,304 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:59,325 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239496ms for 240000ms of delay, sleeping for 514ms
02.12.2021 17:25:59,337 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 269
02.12.2021 17:25:59,337 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 294
02.12.2021 17:25:59,360 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:59,372 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:59,382 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:59,402 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:59,402 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,402 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,402 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,402 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,402 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,402 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,402 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,402 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:59,437 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 169
02.12.2021 17:25:59,438 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 194
02.12.2021 17:25:59,458 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119400ms for 120000ms of delay, sleeping for 610ms
02.12.2021 17:25:59,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:59,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,460 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,460 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:59,473 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:59,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:59,479 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,479 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,480 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:59,503 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:59,538 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 68
02.12.2021 17:25:59,538 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 93
02.12.2021 17:25:59,562 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 398
02.12.2021 17:25:59,575 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:59,580 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:59,603 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:59,607 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,608 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:59,608 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:59,608 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:59,609 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:59,609 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:59,609 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:59,609 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:59,612 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:59,612 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:59,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:59,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,613 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,615 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:59,632 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,632 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:59,632 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:59,633 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:59,633 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:59,633 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:59,633 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:59,633 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:59,633 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:59,634 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:59,634 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4] State transition from REBALANCING to RUNNING
02.12.2021 17:25:59,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:59,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,635 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,636 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,636 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:59,662 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:59,677 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:59,681 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:59,703 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:59,716 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:59,738 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:59,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,777 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,777 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:59,762 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:59,786 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:59,806 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:59,818 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:59,843 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239653ms for 240000ms of delay, sleeping for 357ms
02.12.2021 17:25:59,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 290
02.12.2021 17:25:59,877 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:59,881 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 79
02.12.2021 17:25:59,896 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 84
02.12.2021 17:25:59,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:59,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,904 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,906 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:59,922 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 193
02.12.2021 17:25:59,948 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-7bc41ba9-9d2e-4546-8593-56556fd30ef4-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 190
02.12.2021 17:25:59,960 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:59,960 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,960 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,960 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,960 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,960 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,960 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,961 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-46d9f289-0630-4b19-b7f2-c59e02299906-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:59,978 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:59,984 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:59,984 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,984 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,985 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,985 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,985 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,985 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,985 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,985 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-bde208ee-bf75-4403-8522-da8f96d594d9-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500